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ABSTRACT 


This  thesis  analyzes  the  inqiact  of  the  Navy’s  fully-fiinded  graduate  education 
program  on  Surface  Warfare  Officer  pmfcnmance.  Three  measures  of  officer 
performance  are  used:  (1)  probability  of  promotion  to  0-4;  (2)  percent  of  all  LT 
FTTREPs  recommended  for  early  promotion;  and  (3)  the  probability  of  receiving^^ 
an  early  promotion  recommendation  on  the  last  LT  FTTREP.  Navy  Officer  Master 
Files  (FY1981  through  FY1990),  created  by  Prof.  William  Bowman,  USNA,  are 
merged  with  NPRDC’s  Officer  FTTR^  Files  to  statistically  analyze  performance 
differences  between  SurfEU^e  Warfare  Officers  with  and  without  fully-funded 
graduate  education.  Ordinary  least  squares  and  non-linear  maximum  lil^lihood 
techniques  are  used  to  estimate  the  three  performance  models.  Since  selection  into 
the  fully-fiinded  program  is  not  random,  an  attempt  is  made  to  model  the  selection 
process  and  to  correct  for  the  potential  bias  in  the  estimated  coefficient  of  graduate 
education  in  the  performance  models,  llie  findings  reveal  that  fully-fiinded 
graduate  education  has  a  significant  positive  impact  on  the  probability  of  promotion 
to  0-4,  but  insignificant  effects  on  receiving  early  promotion  recommendations  on 
LT  FTTREPs.  Additionally,  selectivity  does  not  appear  to  bias  estimates  of  fully- 
fiinded  graduate  education  in  the  performance  models. 
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I.  INTROD17CTZON 


6rad\iate  education  Is  both  a  noble  Idea,  and  an  ongoing 
necessity  that  enhances  the  quality  leadership  essential 
for  the  United  States  Navy.  I  believe  graduate  education 
Is  one  of  the  tools  absolutely  required  for  officers  who 
will  face  growing  cooplexltles  In  technological, 
managerial  and  polltlcal/economlc  fields  In  the  Navy. 
Even  In  this  era  of  fiscal  austerity  cmd  coo^etlng 
requirements  placed  upon  our  junior  officers.  Investment 
In  graduate  education  must  be  pursued  as  a  priority.  [Ref. 
l:p.  6] 

--  AOM  Frank  B.  Kelso, II,  Chief  of  Naval  Operations,  on 
graduate  education  policy. 


A.  BACKGROUND 

Today's  highly  con5>etltlve  economic  environment,  combined 
with  a  rapid  rate  of  technological  advancement,  has  placed  new 
en^jhasls  on  smaller,  yet  more  productive  labor  forces  in  both 
clvllleui  and  military  organizations.  Graduate  education  has 
emerged  as  a  viable  mecuis  to  "retool’’  mid- grade  managers  and 
officers  with  the  required  knowledge  and  skills  to  succeed  In 
this  challenging  and  rapidly  changing  environment. 

As  the  value  of  graduate  education  for  both  the  employer 
and  the  recipient  continues  to  Increase,  and  In  light  of  the 
current  reductions  in  Navy  officer  end  strength  and  defense 
appropriations,  it  is  in^ortant  to  estimate  the  true  value  of 
graduate  education  to  both  the  Navy  and  the  recipient.  The 
theory  of  human  capital  investment,  discussed  in  detail  in 
Chapter  II,  suggests  that  formal  education  increases 
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productivity  emd  earnings  of  an  individual  over  time.  In  the 
civilian  labor  force,  returns  to  education  may  be  measured  by 
increased  earnings.  In  the  military,  returns  to  education  may 
be  measured  by  increased  earnings  as  a  result  of  promotion 
(which  is  infrequent) ,  and  with  length  of  service  within 
grade.  Thus,  changes  in  productivity  Ccui  be  measured  by 
changes  in  perfomieuice  within  amd  across  reuik,  and 
alternatively  by  longer  job  tenure  -  or  years  of  service  -  as 
a  measure  of  an  additional  contribution  to  the  Navy.  [Ref.  2] 

This  study  analyzes  the  impact  of  graduate  education  that 
is  fully- fiinded  by  the  Navy  on  Surface  Warfare  Officers  (SWO) 
utilizing  two  measures  of  perf  oimiance :  promotion  to 
Lieutenant  Commander  (0-4)  euid  performance  on  Lieutencuit 
fitness  reports  (PITREPS) .  Two  aspects  of  the  LT  FITREPs  are 
used:  (1)  the  percent  recommended  for  early  promotion  (RAP) , 
and  (2)  whether  or  not  the  final  LT  PITREP  (just  prior  to  the 
0-4  selection  board)  receives  cin  early  promotion 
recommendation.  The  focus  here  is  on  job  performance,  rather 
than  job  tenure,  as  the  latter  is  no  longer  critical  to  the 
Navy  in  an  environment  of  reduced  end  strength. 

The  officer  data  file  used  in  this  thesis  is  based  on  the 
Officer  Promotion  History  Data  Pile  (FY's  1981  through  1990) 
obtained  from  Dr.  William  R.  Bowman  of  the  U.S.  Naval  Acadenqr 
(USNA) ,  and  the  Officer  Fitness  Report  Files  from  the  Naval 
Personnel  Research  and  Development  Center  (NPRDC) ,  San  Diego. 
Figure  1,  which  is  derived  from  these  two  data  sources, 
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reveals  that  Surface  Warfare  officers  with  fully- funded 
graduate  education  (FF6E) ,  when  corrpared  to  all  other  SWOs, 
were  promoted  17  percentage  points  higher,  received  10  percent 
more  recommendations  for  early  promotion  on  all  LT  fitness 
reports,  auad  were  5  percent  more  likely  to  receive  cua  early 
promotion  recommendation  on  the  last  LT  FITREP. 


PROMOTION  TO  IM /UO  LT  FIIRBP8  RAPPB) 
PmtMO 

100-1 - 
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Figure  1.  Promotion,  and  LT  fitriqp  perfonuuice 
distribution  of  fully- funded  graduate  educated 
versus  all  other  Surface  Warfare  Officers  {FY  85- 
90) . 

Source:  XTSNA  and  NPRDC. 


The  question  that  remains  to  be  euiswered  is  how  much  of 
these  differences  in  performance  between  graduate  educated  and 
non -graduate  educated  SWOs  is  due  to: 

1.  An  increase  in  productivity  attributed  to  graduate 
education  and  the  increased  stock  of  hiiman  capital; 

2.  Observed  demographic  characteristics,  undergraduate 
experience,  or  Navy  experience; 

3.  Unobserved  factors  accounting  for  the  fact  that  officers 
selected  for  graduate  education  are  already  established 
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as  top  performers  and  are  Inherently  more  pronotable  due 
to  motivation,  innate  ability,  desire  for  achievonent , 
contacts,  health,  attitudes,  aind  interests.^ 

To  fully  iinderstand  the  isplications  of  graduate  education 
on  performance,  one  must  first  xinderstamd  the  various  graduate 
education  opportiinities  afforded  Naval  officers  emd  the 
requirements  for  each.  Officers  who  attend  graduate  school 
full-time  under  euay  partially  or  fully- funded  program  of  26 
weeks  or  more  are  considered  funded.  Funded  programs  are 
limited  to  providing  sufficient  officers  with  siibspecialties 
to  fill  validated  billet  requirements.  Officers  may  pursue 
fully- ftinded  graduate  education  at  the  Naval  Postgraduate 
School  (NPS) ,  Monterey,  Ch  or  at  selected  Department  of 
Defense  (DOD)  and  civilleui  institutions  (CIVINS) .  [Ref.  3] 
The  officer  receives  full  pay  and  allowamces  with  the  majority 
of  tuition  euid  other  schooling  costs  being  assiuned  or  paid  by 
the  Navy.  The  officer  attends  school  instead  of  performing 
usual  military  duties.  [Ref.  4]  The  officer  agrees  to 
obligate  himself  or  herself  to  active  duty  equal  to  a  period 
three  times  the  length  of  education  through  the  first  year  and 
one  month  for  each  month  thereafter.  Officers  receiving 
fully- funded  degrees  are  required  to  serve  one  tour  in  a 


^  As  discussed  in  more  detail  below,  a  major  problem  with 
estimating  returns  to  graduate  education  is  the  "selection  bias" 
that  results  from  individuals  who  self -select  and/or  are  selected 
by  the  Navy  for  graduate  education,  who  would  later  be  more  likely 
to  promote  even  in  the  absence  of  graduate  education. 
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validated  subspecialty  position  as  soon  as  possible  but  not 
later  than  the  second  tour  following  graduation.  [Ref.  3] 

In  a  partially  funded  program,  the  officer  receives  full 
pay  and  allowances  with  the  majority  of  tuition  and  other 
schooling  costs  paid  by  the  officer.  As  with  the  fully- funded 
program,  the  officer  attends  school  instead  of  performing 
usual  military  duties,  incurs  the  same  active  duty  obligation, 
and  is  to  serve  in  a  validated  subspecialty  tour  within  the 
same  period.  [Ref.  4] 

Graduate  education  through  the  tuition  assistemce  (T/A) 
program  is  pursued  by  the  officer  during  off-duty  time  while 
receiving  full  pay  and  allowances.  The  officer  receives  75 
percent  of  tuition  costs  from  the  Navy  for  one  degree  program 
only,  which  is  based  on  a  certain  amount  of  money  per  credit 
hour  and  is  capped  on  an  annual  basis.  This  program  allows 
the  officer  to  choose  his/her  area  of  study  and  incurs  a  two 
year  obligation  upon  completion.  [Ref.  5] 

Unfunded  graduate  education  is  pursued  by  the  officer 
during  off-duty  time  and  all  costs  are  incurred  by  the 
officer.  No  additional  active  duty  obligation  is  incurred  anri 
an  officer  may  or  may  not  receive  a  validated  subspecialty. 
Officers  are  free  to  pursue  any  area  of  study  desired.  [Ref. 
4] 
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B.  OBJBCTZVB 

The  objective  of  this  thesis  is  to  obtain  accurate 
estimates  of  the  impact  of  fully- funded  graduate  education  on 
two  measures  of  performcuice,  promotion  to  0-4  and  LT  FITREP 
performcuice,  broken  down  into  the  percentage  of  all  LT  fitness 
reports  recommended  for  early  promotion  and  whether  the  last 
LT  FITREP  receives  an  early  promotion  recommendation  for 
Surface  Warfare  officers.  Utilizing  multivariate  modeling 
technic[ues,  the  intention  is  to  isolate  performamce 

differences  between  SWOs  with  and  without  fully- funded 
graduate  education,  and  to  apply  standard  techniques  to 
correct  the  estimates  for  selection  bias.  The  eUslllty  to  tr 
euid  correct  for  potential  selectivity  bias  cissoclated  with 
graduate  education  selection  depends  on  how  effective  the 
selection  model  is  in  its  predictions. 

The  Navy's  Investment  in  fully- funded  graduate  education 
is  significant.  In  1994,  the  annual  cost  for  fully- fxinded 
graduate  education  programs  is  projected  to  ve  approximately 
$174. 5M.  [Ref.  5]  The  results  of  this  cuialysis  will  address 
what  the  payoff  is  to  the  Navy  from  its  significcuat  investment 
in  graduate  education,  emd  whether  or  not  removing  cm  officer 
from  the  surface  warfare  environment  to  obtain  a  graduate 
education  is  career- enhancing  to  the  officer. 
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C.  SCOPE,  LZMXTATIQNS,  END  ASSUMPTZGHS 

The  data  set  used  to  define  the  research  population, 
originally  created  by  Professor  WilliaunfR.  Bowmam  of  the  Naval 
Acaden^,  contained  all  officers  going  before  the  promotion 
selection  board  for  Lieutencuit  (0-3)  between  fiscal  years  1961 
and  1985  euid  Lieutenant  Commander  board  (0-4)  between  fiscal 
years  1985  euid  1990.  This  data  set  is  merged  with  fitness 
report  files  (supplied  by  NPRDC)  to  allow  the  researcher  to 
track  an  officer's  performance  from  the  time  of  commissioning 
through  selection  to  0-4,  or  xintil  the  officer  separated  from 
the  Navy. 

Due  to  differences  in  how  different  communities  evaluate 
officers,  and  sharp  differences  in  career  paths  between 
communities,  only  one  Unrestricted  Line  (URL)  community  was 
chosen  as  the  subject  of  this  research  effort.  The  Surface 
Warfare  Officer  (SWO)  community  was  chosen  because  of  its 
highly  structured  career  path  and  the  fact  that  SWOs  comprise 
a  majority  of  URL  officers. 

To  ensure  there  were  no  missing  values  for  any  variables, 
only  SWOs  with  conplete  data  on  all  varieUbles  used  in  the 
regression  models  were  included  in  the  analysis.^  Officers 
transferring  into  the  SWO  community  were  included  in  the 
analysis  because  most  of  these  transitions  occur  very  early  in 
one's  career,  and  well  before  the  LT  selection  board. 

^  This  process  resulted  in  only  283  observations,  or  15 
percent,  of  the  original  sample  being  excluded  from  the  study. 
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Officers  leaving  the  SWO  coomunlty  were  not  Incliided  In  the 


population  and  were  automatically  removed  from 
consideration . ^ 

In  an  effort  to  maintain  consistent  measures  of  the  ioqpact 
of  graduate  education  on  perfornmnce  and  due  to  the  fact  that 
officers  with  fully- funded  graduate  education  comprise  84 
percent  of  all  those  with  graduate  education  In  the  sample, 
the  "treatment  group*  Is  restricted  to  only  those  officers 
with  fully- funded  graduate  educations.  Considering  the 
signiflceuit  Investment  Incurred  by  the  Navy  In  providing 
fully- funded  graduate  education,  restricting  the  treatment 
group  to  those  with  fully- funded  education  (FF6E)  will  focus 
on  the  group  with  the  greatest  inportauice  to  graduate 
education  policy  maUcers.  Since  Naval  Postgraduate  School 
(NFS)  graduates  constitute  96  percent  of  all  FFGE's  In  the 
sample,  NFS  amd  FFGE  may  be  considered  synonymous  in  this 
study. 

The  Master  Loss  File  Is  available  in  the  data,  but  nearly 
all  who  left  the  Navy  prior  to  the  LCDR  selection  board  did 
not  have  fully- funded  graduate  degrees.  Because  fully- funded 
graduate  degree  recipients  incur  aui  additional  obligation 
averaging  four  years.  It  was  decided  not  to  attempt  to  amalyze 
retention  behavior.  However,  officers  deciding  to  remain  In 
the  Navy  beyond  Initial  obligation  may  differ  systematically 

^  This  resulted  ins.  only  147  observations  that  were  excluded 
from  the  study. 
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from  those  choosing  to  leave.  The  factors  that  are  associated 
with  these  differences  could  be  Important  to  performance  and 
promotion.  This  separation  decision  Is  considered  am 
Important  level  of  selection  prior  to  the  0-4  promotion  board 
euad  It  Is  analyzed  In  the  appendix. 

Three  perfozmaLnce  measures  are  used  In  this  thesis: 

1.  probability  of  promotion  to  0-4; 

2.  percent  of  all  LT  FITREPs  receiving  an  early  promotion 
recommendat Ion ; 

3.  probability  of  receiving  cm  early  promotion 
recommendation  on  the  last  LT  FITREP. 

This  thesis  euialyzes  promotion  emd  whether  the  last  LT  FITREP 

receives  a  recommendation  for  early  promotion  (RAP)  In  a 

binary  fashion  utilizing  nonlinear  regression  (logit)  models. 

The  measure  of  the  percent  of  all  LT  FITREPS  that  receive 

"RAPS"  Is  analyzed  In  a  linear  fashion  utilizing  an  ordinary 

least  squares  (OLS)  regression  technique. 

Selection  for  fully- funded  graduate  education  is  modeled 
In  a  binary  fashion  utilizing  a  nonlinear,  maximum  likelihood 
(problt)  estimating  procedure.  This  statistical  technique 
produces  estimates  of  the  likelihood  of  graduate  education 
selection  for  each  officer  In  the  sanple.  The  contention  that 
officers  selected  for  graduate  education  are  Inherently  more 
productive  cmd  perform  at  a  higher  level  suggests  that  there 
are  some  ;inobserved  (unmeasuredsle)  factors  related  to 
performcuice  outcomes.  Multivariate  regression  analysis 
captures  these  unobservaQsles  In  an  error  term.  If  a 
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significant  correlation  exists  between  this  error  term  and  the 
graduate  education  independent  variable,  the  estimates  of  the 
impact  of  graduate  education  on  officer  performance  will  be 
"biased."  In  this  case,  the  presence  of  selectivity  bias 
could  cause  the  estimated  coefficient  of  graduate  education  to 
overestimate  its  true  ispact  on  the  three  performamce 
measures . 

In  order  to  obtain  accurate  estimates  of  graduate 
education,  two  different  procedures  --  referred  to  as  "the 
Heckman"  and  "the  Bamow"  approaches  --  are  used  to  correct 
for  potential  selectivity  bias  in  the  measures  of  performance. 
Critical  to  the  effectiveness  of  these  procedures  is  the 
assunptlon  that  selection  for  graduate  education  is  not  remdom 
euad  the  degree  of  success  associated  with  the  ability  to 
accurately  predict  selection  will  determine  if  selectivity 
bias  is  inportant .  These  procedures  will  be  discussed  in  more 
detail  in  Chapters  II  euid  III  below. 

D.  ORGANIZATION  OF  THE  STDDT 

This  study  is  orgcuiized  into  five  chapters.  Chapter  II 
reviews  pertinent  literature  and  previous  studies  relevant  to 
hiunan  capital  investment  theory,  military  promotion,  the  use 
of  fitness  reports  as  measures  of  performance,  and  selectivity 
bias.  Chapter  III  describes  the  data  sets  used  in  the  thesis 
and  discusses  the  specification  of  the  various  multivariate 
models  to  be  estimated.  Chapter  IV  presents  the  empirical 
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results  of  bivariate  and  multivariate  analyses  of  the  models. 
Chapter  V  sxunnarizes  the  results,  and  provides  conclusions  and 
recommendations  on  further  research.  ^ 
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IX.  LITXMLTDBS  BBVZIIf 

This  chapter  includes  reviews  of  relevant  previous 
research  efforts  In  four  different  areas  relevemt  to  this 
thesis.  These  areas  Include:  huruui  capital  Investment 
theory,  research  on  personnel  promotion,  research  on  officer 
performance  (FITREPs) ,  oind  analyses  of  selectivity  bias. 

The  costs  and  benefits  associated  with  cm  Investment  In 
graduate  education  cam  be  slzaJsle  for  both  the  provider  amd 
recipient.  Although  the  Navy  Incurs  much  of  the  monetary  cost 
for  fully- fimded  programs,  there  are  non-monetary  costs  that 
the  officer  must  weigh  In  his  or  her  decision  to  pursue 
graduate  education.  Humam  capital  Investment  theory  provides 
a  framework  for  Identifying  the  relevamt  costs  amd  benefits. 

Previous  research  on  assessing  the  inqpact  of  graduate 
education  on  en^loyee  promotion  and  performance  Is  extremely 
limited.  Two  studies  of  promotion  were  chosen  for  the 
literature  review  in  this  chapter  on  the  basis  of  relevance 
and  similarities  to  Independent  variables  used  In  this  thesis. 
Other  research  efforts  on  perfozmamce  that  utilized  fitness 
reports  are  also  reviewed  because  they  provide  the  basis  for 
the  development  of  the  FITREP  performance  indexes  used  In  this 
thesis.  Finally,  given  that  potential  selectivity  bias  Is  cm 
underlying  theme  throughout  this  thesis.  It  Is  Inportant  to 
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define  the  nature  and  the  effects  of  selectivity  In  the 
analysis  of  graduate  education,  emd  how  It  cam  be  accounted 
for  In  statistical  models  of  officer  perf ormauice . 

A.  HUMAN  CAPITAL  INVBSTMENT  TEBOHT 

Capital  Investments,  by  definition,  entail  an  initial  cost 
that  the  Investor  hopes  to  recoup  over  some  future  period  of 
time.  Traditionally,  capital  Investments  were  considered  In 
terms  of  nonhuman  assets  such  as,  land,  buildings,  and 
machinery.  However,  a  relatively  new  use  of  "human  capital" 
has  given  Investment  a  new  meauilng.  Hiunam  capital  Investments 
Include  such  activities  as  education,  job  training,  euid 
migration.^  All  three  Incur  Initial  costs  and  are  made  with 
the  e3{pectation  that  the  investment  will  pay  off  well  into  the 
future  in  the  form  of  higher  productivity  (and  therefore 
earnings) ,  reduced  job  turnover,  and  Increased  job 
satisfaction.  [Ref.  6]  For  the  purposes  of  this  study,  only 
one  type  of  human  capital  Investment  will  be  discussed,  that 
of  formal  education. 


*  Human  capital  investment  in  education  incur  initial  costs 
to  the  enqployer  (provider)  through  tuition  and  forgone  productivity 
by  the  eirployee  during  education. 

Humcui  capital  investment  in  iob  training  intends  to  provide 
increased  slcllls  to  workers,  resulting  in  higher 
productivity/eamings . 

Human  capital  investment  in  migration  refers  to  voluntary 
(job  quitting)  and  involuntary  lay-offs.  Costs  incurred  by  the 
employee  are  induced  by  earnings  lost  during  the  search  for  new 
employment  and  relocation.  [Ref.  6] 
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This  thesis  concentrates  on  the  Navy's  investment  in  its 
fully- fxinded  graduate  education  program.  The  increased 
knowledge  and  skills  associated  with  graduate  education 
represent  eui  increase  in  the  recipient's  stock  of  productive 
capital.  In  the  civllieui  leQsor  market,  am  increase  in  one's 
human  capital  is  typically  measured  by  an  increase  in 
earnings,  as  more  precise  data  on  individual  productivity  is 
not  available.  [Ref.  6]  In  the  military.  Individual 
performance  can  be  measured,  which  allows  the  researcher  to 
estimate  more  clearly  the  returns  to  hurnein  capital  con^ared  to 
the  multitude  of  human  capital  research  in  the  civilian  labor 
market . 

Three  main  elements  of  hurnam  capital  investment  theory  are 
central  to  this  study:  (1)  whether  the  training  (or 
education)  is  specific  or  general;  (2)  the  meauis  of 
fineuicing;  (3)  cuid  the  timing  of  the  Investment.  First, 
hviman  capital  investments  in  graduate  education  may  be  general 
or  specific  in  nature.  General  education  (or  training) 
increases  sm  individual's  productivity  to  many  en^loyers 
equally,  including  the  Navy,  whereas  specific  education 
increases  an  individual's  productivity  only  to  the  Navy  (or 
the  firm  in  which  he  or  she  is  currently  enployed) .  [Ref.  6] 
The  majority  of  course  work  in  a  civilian  master's  degree  in 
Business  Administration  (MBA)  is  general  in  nature  due  to  its 
value  to  a  wide  variety  of  enployers.  Certain  required 
courses  within  the  Navy's  fully- funded  graduate  education 
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progreuna,  not  available  in  civilian  graduate  programs,  are 
designed  by  Navy  sponsors  emd  are  "fizm  specific”  to  the  Navy. 
These  military  courses  may  lessen  the  ^attractiveness  of  the 
program  to  private  sector  enployers  coopared  to  civilicua 
graduate  programs.  Further  more,  some  fully- funded  graduate 
programs,  like  Anti-S\ibmarine  Warfare  offered  at  the  Naval 
Postgraduate  School  (NPS)  is  wholly  specific  to  the  Navy.  In 
general,  curricula  offered  through  the  Navy's  fully- funded 
programs  en^hasize  specific  naval  applications,  but  as  with 
any  accredited  academic  institution,  a  plethora  of  siibjects 
taken  by  the  students  are  general  in  nature.  To  the  extent 
that  a  graduate  degree  has  general  conqponents ,  the  recipient 
becomes  more  marketable  for  lucrative  civilicLn  job 
opportunities.  Since  the  individual's  potential  civilian  wage 
rises,  a  graduate  degree  tends  to  increase  his  or  her 
probcd)ility  of  leaving  the  Navy.  To  offset  this,  the  Navy 
imposes  cm  additional  service  obligation  accompanying  a  fully- 
funded  graduate  education.  This  binds  the  individual  to  the 
Navy  and  ensures  that  the  Navy  receives  some  return  on  its 
investment . ^ 

The  second  element  central  to  this  study  is  the  means  of 
finemcing  the  graduate  education  investment.  For  education 
that  is  general  in  nature,  the  increase  in  an  employee's 

®  The  return  is  in  the  form  of  having  a  more  "productive" 
officer  fill  specialized  billets  and  in  reducing  turnover  costs 
associated  with  having  to  hire  and  train  less  experienced 
workers/officers . 
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marginal  productivity  after  graduate  education  forces  firms  to 
pay  a  wage  equal  to  or  greater  than  the  value  of  the  Increased 
productivity.  Otherwise,  the  employee  will  choose  to  work  for 
another  firm  willing  to  pay  the  higher  wage.  Since  most 
graduate  education  progreuns  contain  both  general  and  specific 
elements,  costs  incurred  by  the  es^loyer  play  an  essential 
role  in  the  decision  to  provide  graduate  education 
opportunities.  Consequently,  either  firms  will  not  offer 
graduate  education,  or  will  force  the  employees  to  bear  a 
portion  of  the  education  costs  by  paying  them  wages  below  the 
marginal  product  (by  an  amount  ec[ual  to  the  education  cost)  in 
the  post -education  period.  [Ref.  6]  Figure  2  illustrates 
this  marginal  product/eamings  relationship. 

In  contrast  to  the  dilemma  faced  by  civilian  firms,  the 
military  is  somewhat  unique  in  that  it  can  pay  the  full  cost 
of  graduate  education  and  recover  the  investment  through 
extended  service  obligations,  during  which  the  service  member 
is  paid  the  same  pre-graduate  education  wage.  In  economic 
terms,  the  military  is  able  to  acquire  a  "surplus"  by  paying 
the  officer  a  wage  less  than  the  value  of  his  or  her  gain  in 
marginal  productivity.  On  the  other  hand,  there  is  an 
indirect  cost,  commonly  referred  to  as  "opportunity  cost," 
suffered  by  the  military  through  foregone  productivity  of  the 
officer  in  the  fleet  during  graduate  education.  The  military 
is  willing  to  fund  graduate  education  only  if  the  increased 
marginal  benefit  gained  through  graduate  education  exceeds  the 
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Barnings  as  ralatad  to  graduata  education. 


marginal  cost  in  terms  of  foregone  productivity  and  direct 
outlays.  [Ref.  6] 

Individual  officers  pursue  fully- funded  graduate  education 
in  part  because  the  monetary  cost  of  the  education  is  paid  by 
the  Navy,  euid  in  part  because  they  anticipate  greater  returns 
in  the  future  through  x^nhanced  promotion  opportunities  in  the 
Navy  and/or  a  more  conpetitive  position  in  the  civilian  job 
market  at  the  end  of  their  obligation.  Although  these  are 
attractive  benefits,  the  officer  also  incurs  an  opportunity 
cost;  foregone  ]cnowledge,  training,  and  additional 
qualifications  that  might  be  gained  if  he  or  she  instead  chose 
to  remain  within  the  warfare  environment.  Many  officers  fear 
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the  possibility  of  "falling  behind”  their  peers  while  removed 
from  the  high-paced,  competitive,  operational  warfare 
environment . 

The  third  euid  final  element  of  hiuosui  capital  investment 
theory  central  to  this  study  is  the  timing  of  the  Investment. 
In  theory,  greater  returns  from  humam  capital  investments  are 
realized  the  earlier  the  investment  is  undertadcen.  Providing 
graduate  education  early  in  am  officer's  career,  assuming  that 
he/she  remains  in  the  service  for  am  extended  period  of  time, 
affords  the  Navy  a  longer  period  of  time  to  recover  the 
investment.  [Ref.  7]  A  condition  of  the  fully- funded 
graduate  education  program  is  that  officers  serve  a 
utilization  tour  within  their  subspecialty,  attained  through 
graduate  education,  no  more  than  two  years  after  graduation. 
This  tour  is  called  a  "payback"  due  to  its  vital  role  played 
in  recovering  the  Navy's  investment.  This  requirement  is 
difficult  to  enforce  due  to  the  highly  structured  time- 
sensitive  URL  career  paths,  especially  within  the  Surface 
Warfare  community.  Consequently,  the  earlier  the  officer 
receives  the  subspecialty  code,  the  more  likely  he  or  she  will 
serve  a  utilization  tour  sometime  in  their  career.  On  the 
other  hand,  learned  knowledge  of  a  specific  specialty  will 
depreciate  over  time  if  not  applied.  So,  it  is  in  both  the 
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Navy's  cuid  the  officer's  best  interest  to  serve  a  payback  tour 
as  soon  as  possible.^ 

% 

B.  SBSBBRCH  ON  PBRSONMSL  PROMOTION 

The  first  study  reviewed  is  D.J.  Cymrot's,  "Graduate 
Education  and  the  Promotion  of  Officers,  "  which  atteir^ted  to 
assess  the  benefit  to  the  Navy  of  providing  graduate  education 
to  its  officers  in  terms  of  its  intact  on  promotion.  Graduate 
education  may  provide  an  officer  with  technical  or  general 
information  that  better  enables  him  to  handle  greater 
responsibilities  commensurate  with  higher  rank.  If  graduate - 
educated  officers  get  promoted  faster,  and  to  higher  ranks 
than  other  officers,  this  supports  the  contention  that 
graduate  education  increases  productivity  within  the 
organization.  [Ref.  2] 

Cymrot  begins  by  deriving  a  formula  to  calculate  the 
marginal  benefit  to  the  Navy  of  providing  graduate  education 
to  officers.  He  identified  three  factors  affecting  the 
marginal  benefit; 

•  the  productivity  of  the  base- case  officer, 

•  the  difference  in  the  probedsility  of  promotion  to  the  next 
rank  in  each  year. 


®  See  Bowman  [Ref.  5]  for  a  proposal  to  reduce  graduate 
education  human  capital  depreciation  by  separating  the  timing  of 
the  general  education  pqrtion  from  the  firm- specific  portion  of 
fully- funded  graduate  education  in  the  Navy. 
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•  the  change  In  the  productivity  between  ranks  (i.e., 
associated  with  promotion) . 

The  marginal  benefit  Is  the  Increase  In  productivity  (or  the 
marginal  product  of  cm  officer)  that  results  from  graduate 
education.  Cymrot  assiimes  that  productivity  depends  entirely 
on  the  officer's  remk.  The  base-case  officer  Is  defined  as  an 
officer  In  the  lowest  reuik  (LT  with  8  yeaxs  of  service)  .  An 
index  of  productivity  at  each  rank  equals  the  ratio  of  the 
marginal  product  of  a  given  rank,  to  the  marginal  product  of 
the  base- case  officer.  [Ref.  2] 

The  data  used  in  the  emalysls  was  an  extract  from  the 
Officer  Master  File  (OMF) ,  comprising  a  historical  cross 
section  of  all  officers  on  duty  In  March  1985.  The  data  was 
restricted  to  officers  at  certain  lengths  of  service  and  ranks 
to  avoid  having  the  results  affected  by  officers  with  atypical 
careers,  such  as  enlisted  personnel  or  warreuit  officers 
admitted  to  the  officer  corps,  or  staff  officers  who  enter  the 
service  cUsove  the  rank  of  Ensign. 

The  probcdsilities  of  promotion  are  obtained  by  a  logistic 
model,  since  the  dependent  variable  (promote,  not  promote)  Is 
limited  to  values  of  1  or  0.  Three  types  of  e3q>lanatory 
variables  are  used  in  the  promotion  model:  personal 
characteristics  (graduate  degree,  age,  sex,  race) ;  previous 
experience  and  performance  indicators  (time  in  rank,  service 
continuity);  and  Navy  structural  variables  (officer's 
community) .  Since  promotaUaility  is  one  of  the  criteria  used 
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in  determining  whether  am  officer  is  allowed  to  obtain 
graduate  education,  potential  selectivity  bias  exists  due  to 
the  correlation  between  the  dependent  variaJale  (promote)  amd 
assignment  to  the  experlxnental  group  (graduate  educated 
officers) .  Two  varladsles,  time- in> rank  (capturing  promotion 
rates)  and  service  continuity  (identifying  breaUcs  in  service) , 
are  used  by  Cymrot  in  an  attesqpt  to  control  for  potential 
observed  selectivity  bias .  These  two  perf  ormauice  amd 
experience  variaUsles  are  intended  to  accoimt  for  some  of  the 
inherent  differences  in  productivity  associated  with 
individual's  selected  for  graduate  education,  which  should  be 
isolated  from  the  measure  of  graduate  education  itself.  [Ref. 
2] 

Cymrot  examined  four  promotion  points  by  creating 
subsan^les  by  length  of  service  (LOS)  groupings  for  Lieutenant 
to  Lieutenant  Commemder,  Lieutenamt  Ccmmamder  to  Commander, 
Commamder  to  Captain,  amd  Captain  to  Flag.  The  impact  of 
graduate  education  is  positive  and  statistically  significant 
in  all  groups  except  promotion  to  Flag  officer.  The  fact  that 
this  result  persisted  even  with  the  experience  amd  performance 
indicators  (time- in- rank,  and  service  continuity)  included  in 
the  model  (to  account  for  selection) ,  supports  the  contention 
that  graduate  education  does  raise  productivity  by  increasing 
the  likelihood  of  promotion  to  the  next  higher  rank.  In  fact, 
graduate  education  increased  the  probability  of  promotion  to 
Lieutenant  Commander  by  26  percent,  to  Commander  by  10.6 
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percent,  amd  to  Captain  by  16.5  percent.  It  Is  Interesting  to 
note  that  promotion  to  Flag  Is  conditional  on  previous 
promotion  rates,  all  of  which  are  positively  related  to  having 
graduate  education.  Consequently,  It  Is  somewhat  puzzling  why 
graduate  education  Is  not  significant  In  prcdonotlon  to  Flag. 
One  reason  might  be  If  am  officer  Is  slow  In  getting  promoted 
In  the  lower  ranks,  chcinces  are,  he/she  never  made  It  to 
Commander  or  Captain  and  since  those  up  for  Flag  have  already 
undergone  a  great  deal  of  selection,  they  represent  the  best 
the  Navy  has  and  graduate  education  may  seem  unimportant  by 
that  time.  [Ref.  2] 

The  tlme-ln-rauik  performance  variable  consistently  had 
negative  emd  statistically  signlflcemt  coefficients,  meaning 
that  excessive  time  spent  In  previous  razxks  decreases  the 
current  probability  of  promotion.  The  positive  and 
statistically  significant  effect  of  the  service  continuity 
esqperlence  variable  conflicted  with  the  hypothesis  that  a 
break  in  service  would  have  a  negative  effect  on  productivity 
emd  would,  thus,  decrease  the  likelihood  of  promotion.  This 
surprising  result  may  be  due  to  a  large  majority  of  those 
officers  who  leave  and  then  reenter  being  above-average  In 
terms  of  ability  and  performance. 

Other  significant  factors  in  Cymrot's  model  were: 

•  age  had  a  significantly  positive  iirpact  on  promotion, 
meaning  older  officers  (possibly  due  to  prior  enlisted 
service)  are  more  likely  to  promote  than  younger  ones; 
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•  unreatricted  line  offieera  were  significantly  more  likely 
to  promote  than  Staff  or  Restricted  Line,  but  only  for  the 
Lieutenant  to  Lieutenant  Commander  LOS  group;  amd 

•  length  of  service  was  signlflcantlyiposltlve  in  all  cases. 
[Ref.  2] 

Cymrot  then  separated  the  sanple  by  each  successive  length 
of  service  year  in  am  attempt  to  determine  whether  gradiiate 
education  leads  to  early  promotion  or  whether  it  is  only  a 
guaramtee  of  eventiial  promotion.  Separate  logit  models  were 
run  on  the  probaJDility  of  promotion  for  each  year.  The 
results  are  most  striking  at  the  eight  year  point,  at  which 
graduate  education  increases  the  probability  of  early 
promotion  to  Lieutenant  Commamder  by  nearly  60  percent.  The 
effects  for  the  remaining  years  are  relatively  small, 
concluding  that  graduate  education  ensures  only  eventual 
promotion  after  the  eighth  year  of  service.  [Ref.  2] 

In  summary,  Cymrot  certainly  established  a  positive 
relationship  between  promotion  and  graduate  education. 
However,  it  is  vmllkely  that  he  captured  the  "true"  impact  of 
graduate  education  on  promotion.  Since  promotcd>illty  is  a 
criteria  for  graduate  education  selection,  the  presence  of 
selectivity  bias  is  probably  much  more  of  a  potential  problem 
than  he  had  thought.  The  issue  of  wibat  exactly  mcUces  these 
officers,  selected  for  graduate  education,  more  promoted>le 
must  be  addressed. 

There  were  two  ways  in  which  Cymrot  should  have  dealt  with 
graduate  education  selection  bias:  (1)  introduce  previously 
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excluded  observed  (measurable)  factors  as  "proxies”  to  capture 
the  selection  process;  and  (2)  utilize  est8d>ll8hed  statistical 
techniques  to  capture  unobserved  (unmeasurable)  factors 
effecting  selection.  His  attenpt  to  accoiint  for  Inherent 
promotablllty  with  "proxies”  to  capture  previous  promotion 
rates  (time -In- rank)  2uid  bre2Ucs  In  previous  service  Is  not 
adequate  to  fully  explain  graduate  education  selection. 
Promotablllty  Is  not  the  only  criteria  used  In  selection; 
professional  performcuice  within  rank,  which  may  be  captured 
through  fitness  reports «  emd  academic  experience  are  other 
factors  that  need  to  be  addressed.  Vlhen  dealing  with 
selection  bias.  It  Is  necessairy  to  accoiint  for  all  observed 
and  unobserved  factors  contributing  to  selection  Into  the 
"treatment  group"  (graduate  educated  officers)  .  Cymrot  failed 
to  accoxmt  for  unobserved  factors  that  contribute  to  selection 
bias.  There  are  estcUsllshed  statistical  procedures  that  can 
be  used  to  model  the  process  of  self -selection  auid  to 
eliminate  any  biases  caused  by  It. 

A  second  study  looked  at  promotion  probabilities 
exclusively  for  Surface  Warfare  Officers.  Joseph  Nolan  In  his 
NPS  Master's  thesis,  "An  Analysis  of  Surface  Warfare  Officer 
Measures  of  Effectiveness  as  Related  to  Commissioning  Source, 
Undergraduate  Education,  and  Navy  Training, "  developed 
multivariate  models  to  estimate  the  determinants  of  three 
measures  of  effectiveness  (MOE's)  for  Surface  Warfare  Officers 
(SWO) :  retention,  ’ promotion,  and  early  professional 
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qualifications.  Performance  differences  by  conmisslonlng 
source  and  quality  of  undergraduate  education  are  specifically 
highlighted.  [Ref.  8] 

An  updated  version  of  the  Naval  Officer  Promotion  History 
Data  File,  derived  from  the  Navy  Officer  Master  Files,  and 
extracts  from  the  Navy  Officer  Loss  Files  were  obtained  by 
Nolan  from  Dr.  William  Bownmn  of  the  U.S.  Naval  Academy. 
These  files  Included  background,  esq^rlence,  selection  board 
results,  and  separation  Information  for  all  officers  reaching 
Lieutenant  selection  boards  between  fiscal  years  1981  through 
1985  and  Lieutenant  Commander  selection  boards  between  fiscal 
years  1985  through  1990.  Navy  training  Information  tias 
provided  by  the  Naval  Personnel  Research  and  Development 
Center,  San  Diego,  In  Its  TRAINTRACK  System  Files.  The  final 
merged  promotion  data  set  was  restricted  to  Surface  Warfare 
Officers  remaining  within  the  community  to  the  Lieutenant 
Comaiemder  selection  board  emd  to  those  obtaining  a  commission 
through  USNA,  ROTC,  or  OCS.  [Ref.  8] 

The  Independent  varlcibles  used  by  Nolcm  to  measure  the 
likelihood  of  promotion  to  0-4  were  grouped  into  four 
categories:  (1)  personal  demographics  (sex,  race,  dependents, 
age  at  commissioning,  prior  enlisted  service,  commissioning 
source) ;  (2)  undergraduate  education  (major,  6PA,  college 
selectivity,  academic  profile  code) ;  (3)  Navy  experience 
(service  schools,  duty  stations,  billets,  additional 
qualifications,  warfare  designation) ;  and  (4)  Navy  training 
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(acadooic  setback,  skill  progression  training,  f\inctional 
training)  .  In  the  promotlcm  model,  the  effects  of  Navy 
training  are  measured  Indirectly  via  a  variable  Indicating 
attainment  of  early  qualifications  prior  to  the  0-3  selection 
board.  The  goal  was  to  determine  whether  a  correlation 
existed  between  attainment  of  early  qualifications  and 
promotion  to  0-4.  The  sasple  is  further  broken  down  by 
quality  of  imdergraduate  college  (low,  medium,  amd  high)  to 
determine  differences  in  prorotlon  probabilities  based  on 
college  academic  rauik.  Rankings  were  obtained  from  Barron's 
Profiles  of  Americaui  Colleges.  [Ref.  8] 

The  promotion  model  was  estimated  for  a  pooled  Scunple 
consisting  of  all  coamlssioning  sources  autid  college 
selectivity  levels  and  then  separately  by  comnissioning  source 
and  by  college  selectivity  level.  The  results  were  as 
follows : 

(a)  Slgnlficamt  positive  effects  on  promotion  to  0-4 
were  obtained  for  the  following  varied>les:  early 
professional  qualifications,  high  6PA,  high  technical 
c[ualif icatlon  code  (TQC) ,  Engineering  Officer  of  the  Watch 
qualified.  Tactical  Action  Officer  qualified.  Department 
Head  School  graduate,  served  in  a  combat  systems  officer 
department  head  billet,  and  served  as  operations  officer 
(NTDS)  department  head. 

(b)  Significant  negative  effects  were  obtained  for 
being  single,  age  at  commissioning,  cuid  being  male.  It 
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should  be  noted  however,  that  males  constituted  98  percent 
of  the  sample,  reducing  the  reliability  of  the  sex 
variable . 

(c)  Of  the  variables  with  the  largest  positive  impact. 
Department  Head  School  graduates  were  28  percent  more 
likely  to  promote.  Combat  Systsns  Officers  7  percent  more 
likely.  Operations  Officers  (NTDS)  10  percent  more  likely, 
cmd  those  with  Tactical  Action  Officer  qualification  8 
percent  more  likely. 

(d)  Variables  with  negative  impacts  revealed  that 
males  were  20  percent  less  likely  to  promote,  minorities, 
although  insignificant,  were  4  percent  less  likely  to 
promote  them  whites,  and  there  was  no  significemt 
difference  between  commissioning  source  cmd  school 
selectivity.  [Ref.  8] 

In  the  three  promotion  model  specifications  divided  by 
low,  medium,  and  high  college  quality,  graduation  from 
Department  Head  School  was  the  only  variable  significantly 
positive  across  all  three  categories.  Commissioning  source  is 
significant  only  in  the  highly  selective  category,  where  ROTC 
reveals  a  negative  impact  on  promotion  to  0-4.  Significemt 
positive  effects  from  early  qualifications  is  present  in  both 
the  high  and  mediiim  selectivity  groups.  Department  head 
billet  type  was  signifiesmt  only  in  the  medium  selective 
category.  In  the  low- college  quality  category,  only 
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Department  Head  School  graduate  was  positively  significeint  in 
predicting  promotion  to  0-4.  [Ref.  8] 

Two  other  measures  of  effectiveness,  early  professional 
qualification,  and  retention,  were  also  estimated  using 
nonlinear  logit  models.  Early  professional  qualification 
indicated  whether  or  not  an  officer  earned  Additional 
Qualification  Designators  (AQD's)  as  a  Surface  Warfare 
Officer,  Engineering  Officer  of  the  Watch,  or  Officer  of  the 
Deck  (underway) .  The  results  indicate  the  following: 
officers  with  just  one  dependent  were  28  percent  more  likely 
to  attain  early  qualifications  cooqpared  to  single  officers; 
OCS  and  ROTC  graduates  were  5  percent  and  .1  percent  less 
likely  to  attain  early  professional  qualifications  compared  to 
USNA  graduates,  respectively;  white  officers  were  7  percent 
more  likely  them  minorities  to  attain  early  qualifications; 
officers  with  more  them  one  sea  tour  were  13  percent  more 
likely  them  those  with  just  one  sea  tour;  officers  with  am 
academic  setback  or  dropout  from  a  Navy  school  were  9  percent 
less  likely  them  those  without;  emd  an  officer  with  more 
fimctional  or  skill  progression  training  days  is  more  likely 
to  attain  early  qualifications  than  one  with  less  days.  In 
the  model  specifications  divided  by  college  quality, 
fiinctional  training  days  was  the  only  variable  significant 
across  all  three  groups,  and  had  a  positive  impact.  [Ref.  8] 
Retention  was  defined  as  whether  or  not  an  officer 
remained  in  the  service  up  to  the  0-1  promotion  board. 
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Explanatory  variables  including  high  GPA,  high  TQC,  technical 
major,  and  age  at  commissioning  all  had  significant  positive 
effects  on  retention.  VaricQsles  with  significant  negative 
effects  included  white,  OCS  graduate,  ROTC  graduate,  high 
quality  college,  academic  setback/attrition,  cmd  prior 
enlisted  service.  When  analyzed  by  college  quality,  only  two 
variables  were  significant  across  all  three  categories.  Age 
at  commissioning  had  a  significant  positive  effect  on 
retention  and  ROTC  graduate  was  negative  when  conqpared  to  USNA 
in  the  high  quality  category,  positive  when  compared  to  OCS  in 
the  medium,  and  negative  coo^ared  to  OCS  in  the  low  category. 
[Ref.  81 

It  can  be  concluded  from  these  results  that  background 
factors  play  a  significant  role  in  explaining  MOE  attainment. 
Given  the  significance  of  training  investments  for  graduates 
of  medium  and  low- quality  colleges  in  their  MOE  attainment, 
future  budget  cuts  in  Navy  training  will  affect  these  two 
groups  the  most. 

In  light  of  significant  differences  in  promotion 
probabilities  in  the  pooled  model,  there  are  important  policy 
iitplications  to  be  gained  from  Nolan's  results.  The  results 
seem  to  support  the  hypothesis  that  promotion  to  0-4  is  highly 
dependent  on  attainment  of  Department  Head  school  and  key 
qualifications.  Although  multivariate  analysis  of  promotion 
across  college  quality  failed  to  reveal  much,  bivariate 
analysis  determined  that  OCS  commissioned  officers  in  the  high 
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college  giiallty  category  had  promotion  rates  6  and  12 
percentage  points  higher  than  the  medium  and  low  quality 
categories,  respectively.  The  slgnlf icamce  of  the  early 
professional  qualifications  varlahle  may  be  valu8d>le  In 
formulating  future  force  downsizing  policies  In  that  It 
provides  a  measure  of  effectiveness  at  the  three  year  point  In 
predicting  selection  to  the  career  force.  [Ref.  8] 

C.  RESEARCH  ON  OFFICER  FITREFS 

The  report  on  the  fitness  of  officers  (FITREP)  Is  the 
major  document  used  for  periodic  Internal  evaluation  of  the 
performeuice  of  naval  officers.  FITREPs  provide  Information  to 
the  Navy  that  Is  lnq}orteuit  for  promotion,  billet  assignment, 
and  retention.  [Ref.  9]  FITREPs  also  provide  Information  on 
performance  within  rouik,  which  Is  one  of  the  criteria  used  In 
measuring  an  Individuals  productivity  within  the  military. 

Most  Commanding  Officers  (CO's)  con5>lete  FITREPS  with  two 
purposes  In  mind:  promotion  potential,  and  command- related 
selection  decisions.  However,  CO's  have  e3q>ressed  a  conflict 
between  their  obligation  to  Idei.tlfy  average  (or  less  theui 
average)  performers  and  their  obligation  to  write  FITREPS  that 
will  not  destroy  an  officer's  chance  for  promotion. 
Consequently,  most  junior  officers  tend  to  be  ranked  In  the 
top  1  percent  regardless  If  they  deserve  to  be  there  or  not. 
This  quandary  Is  commonly  referred  to  as  "grade  Inflation. " 
The  recurring  problems  of  grade  Inflation,  also  referred  to  as 
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the  "halo  effect,"  have  led  to  questions  of  usefulness  of 
FITREPs  in  selecting  officers  for  prc»notion  and  assignment. 
However,  there  are  a  few  elements  on  FZTREPs  with  sufficient 
varieUsility  to  support  the  belief  of  selection  boards  that  the 
FITREP  is  an  adequate  indicator  of  cm  officer's  promotability 
and  potential  for  command.  [Ref.  9] 

A  study  by  Idell  Neumann  of  the  Navy  Personnel  Research 
and  Development  Center  (NPRDC) ,  San  Diego,  developed  a 
performance  index  derived  from  officer  fitness  reports.  The 
index  was  to  be  used  to  expand  the  scope  of  the  Naval  Academy 
selection  system  by  including  predictions  of  officer 
performance  in  thf;  fleet  after  graduation.  Her  goal  was  to 
estcLblish  a  relationship  among  existing  admission  criteria 
wiiih  the  performance  index  auad  then  develop  predictors  of 
officer  performance  for  applicants  to  be  used  as  part  of  the 
selection  criteria.  [Ref.  10] 

The  data  for  the  development  of  the  performance  index 
consisted  of  all  Naval  Academy  graduates  from  1979  through 
1932  in  the  Surface,  Submarine,  and  Air  warfare  communities. 
These  specific  year  groups  were  chosen  because  these  officers 
had  (at  that  time)  at  least  4  years  of  commissioned  service 
with  officer  fitness  records,  available  USNA  admission 
information  and  performance  scores,  and  response  data  for 
criteria  used  in  the  USNA  admission  program.  Including 
several  year  groups  also  helped  to  account  for  possible 
differences  across  USNA  graduating  classes.  The  data  set  for 
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the  analysis  consisted  of  background  Infomiatlon  provided  by 
the  Naval  Academy,  which  was  merged  with  officer  fitness 
report  information  available  from  NPRDC  files.  [Ref.  10] 

In  order  to  maintain  consistency  across  all  fitness 
reports,  FITRSPs  were  included  for  pay  grades  0-1  to  0-3  based 
on  the  following  criteria:  (1)  if  based  on  "close” 

observation  by  the  reporting  senior;  emd  (2)  if  the  officer 
was  simultemeously  rated  with  other  officers  in  his/her 
command  (either  a  "periodic"  or  "detachment  of  reporting 
senior"  occasion)  .  Neimiemn  selected  three  possible  rating 
elements  within  the  fitness  reports  that  would  encompass  the 
officer's  overall  performauice  on  each  FITREP: 

1.  Command  Desirability;  the  reporting  senior's  rating  of 
the  desircUaility  of  an  officer  being  vmder  his/her 
command  in  a  commauid  assignment; 

2.  Mission  Contribution;  the  evaluation  of  the  officer's 
contribution  to  the  unit's  mission;  and 

3.  Recommendation  for  Promotion;  the  reporting  senior's 
recOTimendation  of  the  individual  for  either  early, 
regular,  or  no  promotion.  [Ref.  10] 

The  distributions  of  the  three  rating  elements  illustrated 

the  difficulties  associated  with  "grade  inflation. "  The 

elements  were  highly  skewed  to  the  upper  end  of  the  evaluation 

scale;  consequently,  a  summary  score  was  used,  which  computed 

the  proportion  of  occasions  on  which  the  officer  received  the 

highest  possible  rating  on  all  qualified  fitness  reports  for 

each  element  was  used.  An  element  summary  score  of  1.0 

indicated  that  the  officer  received  the  highest  rating  on  all 
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FITREPs  in  the  particular  element,  while  a  score  of  0.0 
Indicated  never  receiving  a  top  rating.  Further  evaliiatlon 
revealed  that  "recommended  for  early  promotion”  (REP)  was  the 
only  element  with  sufficient  variability  to  be  used  as  a 
performance  Index.  Only  26  percent  received  "recommended  for 
early  promotion"  over  their  entire  fitness  report  file,  while 
over  58  and  61  percent  of  the  Individuals  received  top  ratings 
over  their  entire  FITREP  file  In  Command  Deslrcdslllty  and 
Mission  Contribution,  respectively.  [Ref.  10] 

Neumcum  further  discovered  slgnlficeuit  differences  In  the 
mean  value  of  the  perfomicuice  Index  between  pay  grades, 
warfare  specialties,  emd  year  groups,  preventing  the  use  of  a 
pooled  saa^le  with  raw  performance  index  scores.  Since  the 
greatest  difference  was  between  grades,  three  separate 
perfoxmcuice  Index  scores  were  confuted  for  each  pay  grade 
(ENS,  LTJG,  and  LT)  .  The  three  scores  were  then  weighted 
according  to  the  number  of  FITREPs  for  each  rank  and  summed  to 
generate  one  performance  index  score  reflecting  an  officer's 
complete  fitness  report  history.  [Ref.  10] 

The  results  of  Neximann's  analysis,  obtained  by  utilizing 
ordinary  least  squares  multivariate  statistical  techniques, 
are  somewhat  surprising.  Out  of  all  the  factors  used  in 
admission  criteria  for  the  Naval  Academy,  only  two  non- 
academic  predictors  had  a  significant  positive  association 
with  REP.  High  school  recommendations  and  extracurricular 
activities  proved  to  be  the  best  predictors  of  officer 
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perf  osnnamce  potential ,  while  academic  criteria  ( 1 .  e . , 
score,  and  high  school  class  rank)  seemed  to  be  unrelated. 
However,  It  should  be  noted  that  those  admitted  to  the  Acadsny 
are  selected  based  upon  superior  academic  perfomtcuice.  [Ref. 
10] 

A  second  officer  performamce  Index  was  developed  by 
William  R.  Bowmein  of  the  U.S.  Naval  Acadeny  In  his  article, 
"Do  Engineers  Make  Better  Naval  Officers?"  Bowmeui  attenqpted 
to  test  the  hypothesis  that  the  best  naval  officers  are  those 
with  a  solid  technical  college  background  (e.g.,  those  who 
major  In  engineering  or  math  and  science)  .  This  was  Icdseled 
the  "Rlckover  hypothesis."  In  contrast  to  Neumcuin's 
performance  Index,  Bowmeui  uses  only  one  fitness  report  to 
measure  performance,  the  last  report  received  as  a  Division 
Officer  (l.e.,  near  the  end  of  the  fourth  year  of  active 
duty)  .  This  FITREP  was  thought  to  provide  the  best  Indication 
of  potential  future  performcmce.  [Ref.  11] 

The  objective  was  to  model  the  statistical  relationship 
between  an  Individual's  academic  major  and  performance  at  the 
Naval  Academy  and  his  performance  later  as  a  junior  officer  in 
the  fleet.  Bowman  analyzed  male  Naval  Academy  graduates  from 
1976  through  1980,  but  restricted  the  sanple  to  those  who 
entered  the  surface  and  submarine  warfare  comirrunities  on  the 
premise  that  these  two  communities  are  the  most  technically 
oriented  and  would  benefit  most  from  technical  degrees.  The 
data  set  was  constructed  by  merging  academic  information 
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contained  in  the  Acadesy's  registration  files,  fleet 
experience  Information  contained  in  the  1986  Navy  Officer 
Master/Loss  file  from  the  Defense  Nainpower  Data  Center, 
Monterey,  amd  a  longitudinal  profile  of  officer  fitness 
reports  from  the  Navy  Personnel  Research  Development  Center, 
San  Diego.  [Ref.  11] 

Bowmam  utilized  two  measures  of  junior  officer  performance 
as  dependent  variables  In  his  multivariate  regression  models 
to  determine  which  graduates  (technical,  or  non- technical) 
are:  (a)  more  llRely  to  achieve  "superior  performamce" ;  amd 
(b)  more  likely  to  remain  In  service  at  least  six  months 
beyond  Initial  period  of  obligation.  [Ref.  11] 

In  the  development  of  his  FITREP-based  performance  Index, 
Bowmam  selected  a  single  FITRBP  that  Indicated  "frequent" 
contact  with  the  reporting  senior  officer,  that  evaluated  the 
officer  In  relation  to  his  peers  (l.e.,  periodic/annual,  or  on 
the  occasion  of  detachment  of  a  reporting  senior  officer) ,  and 
was  the  last  report  as  a  Division  Officer.  A  "superior 
performer"  was  defined  as  one  who  was  recommended  for  early 
promotion,  and  ranked  in  the  top  1  percent  category  both  for 
"command  desirability"  and  in  the  "overall  summary"  evaluation 
on  the  selected  FITREP.  As  was  the  case  In  Neumann's  study. 
Bowman  found  that  "more  discriminating  criteria  for  officer 
superiority  are  not  available  for  junior  naval  officers." 
[Ref.  11] 
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Prior  to  estimating  the  performance  model.  Bowman 
recognized  potential  selection  bias  due  to  two  types  of 
selection  behavior  that  may  indirectly  affect  officer 
performance  and  retention,  since  they  occur  prior  to  entry 
into  the  fleet.  The  first  is  the  screening  process  into  the 
nuclear  surface/suJsmarine  communities.  Training  for  the 
nuclear  power  community  is  highly  technical  so  that  those 
majoring  in  technical  areas  or  others  who  perform  cdsove 
average  in  technical  courses  are  more  likely  to  be  selected 
into  the  progreun.  The  second  is  the  self -selection  process 
whereby  the  officer  chooses  one  warfare  community  over 
another. 

Self -selection  bias  may  exist  if  unobservable  factors, 
such  as  desire,  motivation,  or  attitude,  affect  the  selection 
of  one  community  over  another  and  if  the  unobservable  factors, 
in  turn,  have  an  inpact  on  fleet  performance  and  retention. 
Given  that  nearly  90  percent  of  all  graduates  in  nuclear  power 
communities  have  technical  majors  and  grade  point  averages 
(GPA)  cdsove  2.5  (conpared  to  only  cQsout  50  percent  in 
conventional  surface) ,  failure  to  account  for  xmobserved 
factors  that  may  help  to  explain  this  difference  could  bias 
the  evaluation  of  the  relationship  between  academic  major  cuid 
fleet  performance  and  retention.  [Ref.  11] 
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Bowman  attenqpted  to  teat/control  for  aalf  >aelectlvlty  blaa 
through  the  uae  of  the  Heckman  procedure, which  accounta  for 
unobaeinred  factora  retained  from  the  aelectlon  equation 
through  a  new  ixuiependent  variable  which  ia  placed  in  the  main 
performance  equation.  Thia  variaU^le,  ccamonly  called  the 
Inverse  Mills  ratio  (or  LAMBDA) ,  was  found  to  be  statistically 
insigniflcemt,  meaning  that  selectivity  bias  was  not  detected. 
Although  the  warfare  coomunity  selection  model  provided 
significauit  evidence  that  technical  majors  with  higher  GPA's 
are  more  likely  to  choose  and  be  selected  for  nuclear 
programs,  Bowman  attributed  LAMBDA'S  insignificamce  to  the 
lack  of  correlation  between  the  error  structures  of  the  t%ro 
ec[uations.  [Ref.  11] 

Boiffnaui's  main  performance  model  analyzed  a  binary 
dependent  variable  for  "superior*  performance,  which  was  set>l 
for  a  superior  performer  euid  set-0  otherwise.  The  model  was 
estimated  using  a  nonlinear  logit  technique.  The  first 
category  of  e3q)leUiatory  variables  included  binary  variables 
for  ship  type,  warfare  qualifications,  fitness  report 
parameters,  and  other  variables  for  personal  demographics. 
The  second  category  of  explcmatory  varled>les  were  the  focus  of 
the  study  --  dumn^r  varicd>les  for  academic  major,  eUid  a 
continuous  variable  for  grade  point  average.  Some  notable 
results  include  the  following.  Serving  on  aircraft  carriers, 

^  See  Heckman  [Ref.  12]  for  further  discussion  on  the 
technique  used  to  control  for  potential  selection  bias. 
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relative  to  destroyers  and  ballistic  oilsslle  submarines. 
Increased  the  probability  of  achieving  superior  junior  officer 
performance  by  33.6  and  69.7  percent  In  the  conventional  and 
nuclear  navies,  respectively.  Achieving  a  warfare 
qualification  Increased  superior  performance  by  14.2  percent 
In  the  nuclear  Navy,  and  35.1  percent  In  the  conventional. 
Racial  minorities  were  from  19.2  percent  to  25.6  percent  less 
likely  them  whites  to  achieve  superior  perf ormamce .  [Ref.  11] 
Bowman' s  retention  model  also  emalyzed  a  binary  dependent 
vari.  that  Indicated  whether  or  not  am  officer  stayed  at 
least  six  months  beyond  Initial  obligation.  Some  notaUsle 
results  Include  the  following.  Nuclear  officers  serving  on 
cruisers  amd  attack  submarines  (relative  to  nuclear  ballistic 
siibmarlnes)  were  21.1  percent  and  13.9  percent  more  likely  to 
stay,  respectively.  Occupation  relative  to  am  engineering- 
maintenance  billet  seemed  to  have  the  largest  effect  on  the 
nuclear  Navy,  where  officers  filling  am  administrative  billet 
were  42.6  percent  more  likely  to  stay.  Other  factors  having 
slgnlflcamt  positive  Inlets  on  retention  Included  attaining 
a  warfare  qualification  and  being  black  In  the  conventional 
Navy.  Being  married  (with  or  without  children)  had  a 
slgnlflcamt  negative  Impact  on  retention  In  both  conventional 
and  nuclear  navies.  [Ref.  11] 

Bowmam's  amalysls  of  the  academic  factors  found  few 
slgnlflcamt  relationships  to  jimior  officer  performamce  amd 
retention.  Bowman  contends  that  the  Rlckover  hypothesis 
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cannot  be  supported  because:  (a)  technical  major  is 
statistically  insignificant  in  the  superior  perfonnance  model, 
aad  (b)  management /economics  majors  are  24.1  percent  more 
likely  to  attain  a  superior  performance  rating  relative  to 
engineering  majors  in  the  conventional  surface  Navy.  This 
could  mean  that  jiinior  officer  performance  is  more  dependent 
on  mcuiagerlal  skills  than  technical  knowledge,  a  far  cry  from 
Rlckover's  belief.  [Ref.  11] 

D.  SELBCTXVIT7  BIAS 

An  article  written  by  Burt  S.  Bamow,  Glen  G.  Cain,  and 
Arthur  S.  Goldberger,  entitled  "Issues  in  the  Analysis  of 
Selectivity  Bias,"  indicates  that  selectivity  bias  is  a 
potential  problem  whenever  there  exists  xanmeasured 
(xmobservable)  factors  related  to  am  explanatory  varicQsle  that 
helps  e^lain  both  the  selection  behavior  into  a  "treatment" 
(or  control)  group  and  the  program  outcome  under  study.  The 
term  "bias"  refers  to  the  potential  that  the  estimated  impact 
of  the  explanatory  varicd>le  defining  the  treatment  (control) 
group  on  the  outcome  of  the  main  dependent  variable  is  not 
equal  to  the  "true"  inpact.  If  assignment  to  the  treatment 
group  is  remdom,  then  selectivity  bias  is  not  an  issue,  since 
there  are  no  factors  (observed  or  unobserved)  that 
differentiate  selection  behavior.  However,  selectivity  bias 
continues  to  affect  most  econometric  models  since  assignment 
of  observations  to  treatment  and  conparison  groups  is  seldom 
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esqplicltly  ramdom  especially  in  non-eaqperimental  data.  [Ref. 
13] 

nxe  selectivity  issue  relevant  to  this  thesis  deals  with 
selection  into  the  Navy's  fully- funded  graduate  education 
program.  Navy  graduate  education  policy  makers  base  selection 
for  FFGE  on  academic  capability,  outstamding  professional 
performance,  promotion  potential  amd  a  strong  educational 
background.  [Ref.  3]  This  suggests  that  selection  is  indeed 
not  ramdom  amd  one  must  be  ad)le  to  predict  selection  to  the 
Navy's  graduate  education  program  to  adjust  for  the  potential 
bias  created  by  the  Navy's  selection  process  (amd  self- 
selection  by  individuals) .  There  are  certain  observed  factors 
that  explain  this  selection  process,  but  there  are  also 
signif icamt  unobserved  factors  that  may  affect  both  assignment 
to  the  treatment  group  amd  the  outcome  measure.  For  Instamce, 
outstamding  (pre- graduate  education)  professional  performance 
amd  promotion  potential  may  be  es^lained  by  xinmeasuradjle 
factors  such  as  am  individual's  self-drive,  motivation,  and 
desire  for  achievement.  There  are  established  econometric 
procedures  designed  to  capture  estimates  of  unobserved 
factors,  but  the  success  of  such  procedures  is  dependent  upon 
correct  specification  of  the  selection  model. 

One  common  way  to  attack  selectivity  bias  is  to  singly 
include  a  number  of  "proxy"  variables  in  the  outcome  equation 
thought  to  account  for  the  (observed)  selection  behavior  or 
process .  This  is  the  approach  used  by  Cymrot  in  the  study 
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cited  above  [Ref.  2]  .  This  ai^roach  aernmee  that  there  are  no 
other  variables,  beyond  those  included  as  proxies,  that  are 
related  to  the  outcome.  Obviously,  there  are  flaws  associated 
with  this  approach.  Specifically,  if  explanatory  varicJales 
related  to  selection,  but  not  to  the  outcome  are  omitted,  the 
bias  problem  still  exists.  [Ref.  13] 

A  second  approach  is  a  two- stage  procedure  based  on  work 
done  by  Jcunes  J.  Heckman  [Ref.  12] ,  commonly  called  the 
Heckmain  procedure.  This  technique  is  outlined  in  a  study 
conpleted  for  the  Department  of  Led)or  [Ref.  14]  .  In  the  first 
stage,  selection  into  the  treatment  euid  comparison  groups  is 
modeled  through  a  nonlinear  probit  emalysis  using  at  least  one 
determinant  that  has  no  effect  on  the  main  outcome  equation. 
The  reason  for  using  a  different  variable  in  the  selection 
equation  is  to  ensure  "identification"  of  the  model. ^  In 
addition  to  estimates  of  the  coefficients  in  the  selection 
model,  the  probit  provides  an  estimate  of  a  correction  factor, 
LAMBDA  (X) ,  which  encompasses  values  for  unobserved  factors 
obtained  from  the  error  structure  of  the  selection  model  based 
on  the  probability  of  the  likelihood  of  acquiring  the 
treatment  for  each  observation.  In  the  second  stage,  the 
estimated  LAMBDA  is  included  as  a  regressor  in  the  main 
outcome  equation  along  with  the  treatment  variable  and  other 

®  Identification  is  a  precondition  where  at  least  one  of  the 
predetermined  varicdjles,  from  the  selection  equation,  is  omitted 
from  the  main  equation  to  differentiate  between  the  specifications 
of  the  two  equations.  [Ref.  16] 
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factors  related  to  the  outcone.  The  typical  procedure 
specifies  that  the  outccme  equation  be  estimated  In  a  linear 
fashion  using  ordinary  least  squares  In  order  to  maintain 
consistent  estimates;  however,  this  thesis  uses  nonlinear 
logit  models  for  two  of  the  three  outccane  equations  due  to  the 
binary  nature  of  the  dependent  variables.^  The  Heckmem  two- 
stage  procedure  e^ressed  mathematically  Is  as  follows  [Ref. 
14]  : 

Stage  li 

The  selection  problt  Is  defined  as: 

Pt  ( )  -Pr  ( w>  -v'y  )  * 

o 

where:  z  Is  the  (0,1)  cooparlson/ treatment  group 
Indicator, 

«r  Is  a  normal  reuidom  variable, 
v*y  are  the  estimates  of  a  vector  of  observed 
characteristics  that  influence  selection, 
cr  is  the  st£uidard  deviation  of  z, 

«  Is  the  unit-normal  cumulative  distribution 
function. 

A  correction  factor,  X,  is  then  formed  for  each 

observation: 

for  a  treatment  group  member, 

4>(H)  . 

(9(H})' 


®  Although  two- stage  selection  procedures  generally  specify 
a  linear  ordinary  least  squares  model  to  be  used  in  the  second 
stage,  William  H.  Greene  in  his  LIMDEP  Version  6.0  User's  Manual 
and  Reference  Guide,  makes  reference  to  a  two-step  procedure  that 
supports  the  use  of  nonlinear  regression  techniques  in  both  steps. 
[Ref. 15,  p.637] 
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and  for  ccxnparlson  group  manbers. 


A- 


where : 
and 


Is  the  normal  density  function; 

h.J2^. 

a 


Stags  2: 

The  estimated  value  of  the  correction  factor,  X',  Is 

Included  as  a  regressor  in  the  outcome  equation: 

yi=i®o+xiPi+Y^i+»A.i+|ii 

where:  -  outcome  measure  for  individual  i; 

«  vector  of  explanatory  varieiblee; 

-  indicator  of  selection  status; 

-  estimated  values  of  the  correction 
factor;  and 

li£  •  Individual  ramdom  error  term. 

By  modeling  selection  with  this  two- stage  process,  the 
objective  is  to  specify  a  multiple  regression  that  "holds 
constant"  those  characteristics  not  already  in  the  model  that 
affect  the  outcome  and  are  correlated  with  selection  into  the 
treatment  group.  [Ref.  14] 

There  are  potential  weaknesses  associated  with  the  Heckman 
procedure  that  may  limit  its  effectiveness.  The  probit 
analysis  of  the  selection  model  may  not  yield  accurate 
predictions  if  it  is  not  correctly  specified.  If  the 
selection  process  is  not  explained  well,  the  first  stage 
produces  an  unreliable  estimate  of  the  correction  factor 
(LAMBDA) .  Hence,  including  LAMBDA  in  the  second  stage  may 
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lead  to  ambiguous  estimates  of  the  effect  of  the  treatment. 
If  the  treatment  estimate  seems  unreasonsdsly  large,  for 
exanple,  one  should  check  for  excessive  correlation 
(multi  col  linearity)  between  LAMBDA  and  other  variables  in  the 
second  stage.  Another  limitation  that  may  pose  difficulties 
with  this  procedure  is  the  existence  of  other  types  or  levels 
of  selection  that  precede  the  one  in  question.  Such  a 
sequential  selection  process  would  require  the  use  of  cm 
ordered  probit  analysis,  or  multiple  selection  rules. 
Essentially,  the  Heckmcui  procedure  depends  heavily  on  its 
ability  to  predict  treatment/con^arison  group  status.  [Ref. 
14] 

Finally,  another  concern  with  selectivity  bias  arises  when 
being  in  a  treatment  group  determines  the  outcome.  For 
exanple,  the  fact  that  an  officer  has  attained  fully- fxmded 
graduate  education  may  cause  promotion  to  the  next  higher 
rcuak.  This  causality  is  referred  to  as  endogeneity,  which 
violates  the  econometric  assusption  that  the  error  term  auid 
each  explanatory  varicUale  are  independent  of  each  other. 
[Ref.  16]  A  procedure  developed  by  Burt  S.  Bamow  et  al. 
corrects  for  this  biased  endogenous  relationship  using  a  two- 
stage  process  very  sdLmilar  to  Heckman's.  Bamow' s  first  stage 
is  identical  to  that  of  Heckman's,  in  which  a  probit  analysis 
predicts  selection  into  the  endogenous  treatment  group  and 
probabilities  of  selection  associated  with  each  observation. 
The  second  stage,  instead  of  using  LAMBDA,  uses  the  predicted 
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probabilities  as  eui  ” Instrxunent  variable”  in  place  of  the 
treatment  explanatory  variable  in  the  outcome  equation.  The 
use  of  this  new  instrument  variable  removes  the  endogeneity  as 
well  as  the  correlation  with  the  error  term.  [Ref.  13] 
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IXZ.  ZULTA  AMD  KITBODOLOGtT 


This  chapter  discusses  the  officer  data  base  and  how  It 
was  used  to  develop  e3q)lanatory  variables  related  to  the  three 
measures  of  performance  Introduced  In  Chapter  I .  A  discussion 
of  the  statistical  methodologies  used  In  obtaining  the 
enqplrlcal  results  concludes  the  chapter. 

A.  DATA 

Two  data  sets  were  used  In  this  euialysls.  The  first  was 
obtained  from  Dr.  William  R.  Botnnan  of  the  U.S.  Naval  Academy. 
Using  Information  from  the  Navy  Officer  Master  File, 
maintained  at  the  Defense  Manpower  Data  Center  (DMDC) , 
Monterey,  CA,  he  created  an  updated  version  of  the  Navy 
Officer  Promotion  History  Data  Pile.  Bowman's  data  provided 
the  means  to  create  two  separate  files  containing  background. 
Navy  experience,  and  promotion  selection  board  results  for  all 
officers  going  before  the  Lieutenant  (LT/0-3)  selection  board 
between  fiscal  years  1981  cuad  1985  and  the  Lieutenant 
Commander  (LCDR/0-4}  selection  board  between  fiscal  years  1985 
and  1990.  Merging  these  two  files  determined  which  officers 
remained  in  the  Navy  at  least  until  the  LCDR  selection  board. 

Since  the  focus  of  this  thesis  is  on  Surface  Warfare 
officers,  the  officer  community  designator  was  used  to 
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restrict  the  sample  to  the  Surface  Warfare  coinnunlty.  Only 
the  SWO's  who  remained  In  the  service  through  the  LCSR 
promotion  boaxrd  and  who  stayed  In  the  community  were  retained 
In  the  final  Seuiple.  Officers  transferring  Into  the  SWO 
community  were  Included  since  It  Is  generally  done  early  In 
one's  career.  A  total  of  1,860  SWOs  were  extracted  from 
Bowman's  data  files.  However,  282  observations  were  lost  due 
to  missing  values  when  creating  varlcd>les,  leaving  1,577 
observations  for  the  final  sasple. 

The  second  data  set  used  Is  a  longitudinal  profile  of 
officer  fitness  reports,  obtained  from  the  Navy  Personnel 
Research  amd  Development  Center  (NPRDC) ,  Sam  Diego,  CA. 
Matching  social  security  numbers  from  Bowmam's  data  set  to  the 
FITREP  files  provided  a  conplete  history  of  PiTREPs  for  each 
officer  reaching  the  LCDR  promotion  point.  Although  this 
study  is  restricted  to  Surface  Warfare  officers,  FITREP  file 
histories  were  obtained  for  all  officers  to  facilitate  future 
research  efforts  on  other  URL  communities. 

The  FITREPs  selected  for  inclusion  in  the  analysis  were 
restricted  to  those  that  indicated  "periodic"  or  "detachment 
of  reporting  senior"  in  the  block  for  occasion,  "regular"  in 
the  block  for  type  of  report,  and  "close"  in  the  block  for 
basis  of  the  reporting  senior's  observation  of  the  officer. 
These  restrictions  ensured  that  officers  in  the  saitple  were 
evaluated  against  all  their  peers  in  the  command,  and  that 
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they  worked  closely  with  the  ComoMindlng  Officer,  which  reveals 
a  more  accurate  picture  of  the  officer's  true  perf orxnamce . 

Not  observed  (NOB)  reports,  siibmltted  for  short  periods  of 
duty  or  during  schooling,  fall  to  provide  emy  meaningful 
performance  Information.  Consequently,  they  were  omitted  from 
the  sas^le.  The  data  element  "early,"  containing  the 
recommendation  for  promotion,  was  used  as  the  Indicator  of  an 
observed  report  since  It  Is  left  blemk  on  all  NOB  reports. 
The  final  restriction  on  FITREPs  was  on  the  period  of  the 
report.  Since  Bowman's  data  was  limited  through  fiscal  year 
1990,  FITREPs  submitted  covering  a  period  extending  beyond 
1990  were  omitted. 

Fitness  report  files  for  each  officer  were  siibdlvlded  Into 
two  categories  according  to  rank,  labelled  as  "early"  and 
"late."  Early  FITREPs  Included  those  obtained  as  cm  Ensign 
(0-1)  or  Lieutenant  Junior  Grade  (0-2),  and  late  included 
those  obtained  as  a  Lieutenant  (0-3)  .  The  reason  for  this 
division  is  twofold.  First,  since  early  FITREPs  evaluate  the 
majority  of  the  officer's  initial  obligation,  it  is  of 
interest  to  determine  the  effect  of  early  performance  on  post- 
Inltlal  obligation  performcmce.  Second,  given  that  most 
officers  obtain  graduate  education  during  their  first  shore 
tour,  normally  at  5  to  6  years  of  service,  most  of  the  late 
(LT)  FITREPs  are  received  after  the  attainment  of  graduate 
education.  This  allows  one  to  determine  performance 
differences  before  and  after  graduate  education. 
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The  subsan^le  of  SWO's  (N-1,577),  created  from  Bowman's 
promotion  histoiry  data  files,  emd  the  sanple  of  FITRBP  files 
were  merged  by  assigned  ZD  numbers,  keeping  only  those 
officers  containing  information  in  both  files.  This  merge 
found  100  officers  with  incon^lete  FITRSP  files,  thus  yielding 
a  final  working  sample  of  1,477  SWO  officers. 

Figure  3  displays  the  seven  categories  of  esqplanatory 
varicd)les  used  in  the  statistical  models  of  selection, 
promotion,  percent  of  LT  FITREPS  recommended  for  early 
promotion,  cuid  last  LT  FITREP  RAP.  Although  not  all  the 
varicibles  are  used  in  every  model ,  it  is  important  to 
understcuid  the  process  by  which  each  was  created.  Table  I, 
presented  at  the  end  of  this  section,  specifically  defines  the 
coding  for  each  explanatory  variable. 

The  FITREP  performcuice  variables  were  created  based  on  a 
performance  index  developed  by  Idell  Nuemcuin  at  NPRDC. 
Separate  siunmary  scores  were  calculated  for  FITREPs  defined  as 
early  (EPCTREP)  cuad  late  (LPCTREP)  by  obtaining  the  proportion 
of  all  early  and  late  FITREPS  recommended  for  early  promotion, 
yielding  two  continuous  variables.  As  with  Neumann's  study, 
distributions  of  FITREP  rating  elements  established 
"recommendation  for  early  promotion"  as  the  single  most 


49 


by  oat«goxy. 


discriminating  factor  in  the  rating  of  officers.^^ 

Commissioning  Source  and  undergraduate  college  academic 
rcmk,  obtained  from  Barron's  Profiles  of  American  Colleges, 
were  combined  to  determine  if  performance  differences  could  be 
attributed  to  the  \indergraduate  school's  c[uality.  Highly 


The  data  revealed  that  only  49  percent  of  all  SW)  FITREPs 
were  "recommended  for  early  promotion",  while  70  and  67  percent  of 
all  SWO  FITREPs  received  the  highest  possible  grades  in  "command 
desirability"  and  "mission  contribution",  respectively.  Remaining 
FITREP  elements  revealed  even  greater  skewness  toward  the  upper  end 
of  the  grading  scale. 
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selective  undergraduate  colleges  were  defined  as  those  with 
"most,"  "highly,"  emd  "very  cosqpetltlve"  rankings  In  Barron's 
Profiles.  Schools  with  lower  rankings  In  Barron's  were 
defined  as  having  low  coo^tltlveness .  As  displayed  In  Table 
I,  undergraduate  college  quality  criteria  were  applied  only  to 
officers  from  Reserve  Officer  Training  Contract/Scholarship 
(HISLROTC,  LOSLROTC)  and  Officer  Candidate  School  (HISELOCS, 
LOSELOCS) ,  since  the  majority  of  the  officers  In  the  sanple 
are  comnlssloned  through  the  highly  competitive  Naval  Academy 
(USNA) .  The  six  possible  ccanmlsslonlng  source  variables  are 
binary  In  nature,  and  measured  on  the  positive  condition 
(commission  source-1,  else-O) . 

The  personal  demographic  variables  Include  seven 
Individual  characteristics  that  may  effect  perf ormauice .  The 
sex  of  the  officer  Is  coded  as  a  binary  varled)le,  with 
(FEMALE-l,  else-O)  .  Minority  Is  also  a  binary  varleUble 
(MINORITY) ,  defined  with  race/ethnic  codes  Indicating  black  or 
other  them  white  (black/ other-l,  else-O)  .  The  current  age  of 
the  officer  Is  used  as  a  continuous  variable  (A6EN0W) , 
indicating  the  exact  age  of  the  officer  at  the  time  of  his  or 
her  0-4  selection  board.  Four  additional  binary  variables  are 
used  to  combine  marital  status  and  dependent  information, 
indicating  married  with  children  (MARCHILD) ,  married  without 
children  (MARONLY) ,  divorced  with  children  (DIVCHILD) ,  or 
single  with  no  dependents  (SINGLE) . 
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Variables  indicating  specific  Havy  experience  were 
selected  based  on  certain  qualifications  and  credentials 
considered  vital  early  in  a  Surface  warfare  officer's  career. 
All  eight  experience  variables  are  binary,  indicating  whether 
or  not  the  officer  possesses  a  particular  qualification  or 
credential . 

Nuclear  power  designated  officers  n/ere  identified  through 
the  Additional  Qualification  Designator  (AQD)  data  element. 
Since  nuclear  officers  are  required  to  obtain  their 
engineering  qualification  first,  well  before  consideration  for 
the  0-4  promotion  board,  any  officer  with  an  AQD  in  nuclear 
power  engineering  were  designated  as  a  "NUC. * 

Combatauits  (CRDDBS  ships) ,  including  cruisers,  destroyers, 
frigates,  and  battleships,^^  are  considered  the  "backbone" 
of  the  surface  fleet.  Serving  on  one  of  these  ship  types  is 
considered  career- enhancing  for  SWOs  due  to  the  enphasis 
placed  on  weapon  systems  and  the  fact  that  all  the  Commcuiding 
Officers  are  designated  Surface  Warfare  Officers.  A  data 
element  revealing  duty  stations  was  used  to  coiint  the  number 
of  CRUDES  ships  am  officer  had  served  on.  The  created 
varicUsle  (NOCOMBAT)  indicated  that  an  officer  had  never  served 
on  a  CRUDES  ship. 


Currently,  there  are  no  battleships  in  active  service. 
During  the  period  this  data  was  gathered  (Fiscal  Years  1981-1990), 
all  four  Iowa  class  battleships  were  in  commissioned  service. 
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Attending  SWO  Department  Head  Schcx)l  as  early  as  possible 
after  completion  of  the  first  sea  tour  Is  essential  In  the  StfO 
career  path.  Surface  program  mamagers  contend  that  conqpletlng 
Department  Head  School  by  the  seventh  year  of  service  Is  vital 
within  the  designed  SHO  time- line  to  meet  designated  career 
goals.  Since  promotion  to  0-4  generally  occurs  In  the  eighth 
to  ninth  year  of  service,  completion  of  Department  Head  School 
before  the  selection  board  Is  crucial.  A  data  element 
Indicating  service  schools  attended  was  used  to  Identify 
whether  or  not  am  officer  had  completed  the  Department  Head 
course.  The  created  variable  (NODEPHD)  signifies  that  am 
officer  has  not  yet  attended  Department  Head  School. 

There  are  three  essential  (|uallflcatlons  that  a  SWO  must 
obtain:  (1)  qualification  as  a  Surface  Warfare  Officer 
(SWOQUAL) ;  (2)  Engineering  Officer  of  the  Watch  (EOOWQUAL) ; 
amd  (3)  Tactical  Action  Officer  (TAOQUAL)  .  Using  the  AQD  data 
element,  two  sets  of  varlaUsles  Identifying  c[uallflcatlons  in 
these  three  areas  were  created:  (l)  whether  or  not  the 
officer  had  attained  EOOW  or  TAO  prior  to  the  0-4  board;  amd, 
(2)  whether  or  not  the  officer  had  achieved  an  early  SWO, 
EOOW,  or  TAO  (Qualification  prior  to  the  0-3  board.  SWO 
(Qualification  after  the  0-3  board  was  not  Included  In  the 
analysis,  since  It  Is  required  during  the  first  sea  tour  and 
nearly  all  the  officers  in  the  sanple  had  ac(Qulred  it  by  then. 

Criteria  for  graduate  education  selection  is  contained  in 
the  academic  profile  variables.  Three  continuous  varlcUbles 


from  Bowman's  data  are  used  to  Indicate  undergraduate 
education  esqperience  amd  performamce: 

1.  undergraduate  Grade  Point  Average  (GPA)  is  assigned 
values  ramglng  from  0  to  5,  0  being  the  lowest  and  5  the 
highest ; 

2 .  Math  Qualification  Code  (MQC)  is  assigned  values  ranging 
from  0  to  6  in  ascending  order  of  calculus  difficulty 
and  performamce; 

3.  Technical  Qualification  Code  (TQC)  is  assigned  values 
ramging  from  0  to  5  in  ascending  order  of  physics 
difficulty  amd  performamce. 

An  additional  continuous  variaQsle  utilizes  these  three 
academic  profile  codes  to  determine  the  number  of  Naval 
Postgraduate  School  (NPS)  curricula  one  is  eligible  for 
(ELI6CUSR) .  Criteria  for  this  measure  was  obtained  from  the 
Naval  Postgraduate  School  Catalogue  of  courses  for  1993 . 
(Ref.  1]  Surface  Warfare  officers  are  eligible  for  29  out  of 
a  total  of  38  avalladsle  curricula  and  the  values  for  this 
varicd>le  range  from  0  to  29. 

Department  of  the  Navy  officer  mcuining  requirements  change 
from  year  to  year.  Consequently,  a  variable  indicating  the 
fiscal  year  of  each  officer's  selection  board  (FYSB85-FYSB90) 
was  used  to  control  for  potential  differences  in  promotion 
opportunity  across  different  year  groups. 

Officers  with  fully- fimded  graduate  educations  comprise 
the  "control  (or  treatment)  group"  since  they  are  the  focus  of 
this  study  and  are  con^jared  to  the  remaining  officers  in  the 
sanple  without  this  "treatment."  The  data  element  used  to 
create  this  treatment  variable  (FFGE)  included  four 
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conditions:  (1)  NPS  graduate  degree,  (2)  fully-funded 
civilian  school  graduate  degree,  (3)  non-funded  graduate 
degree,  or  (4)  no  graduate  degree.  Combining  the  first  two 
possibilities  defined  the  group  of  officers  with  fully- funded 
graduate  education. 

TcUsle  I  provides  a  complete  description  of  the  definitions 
of  the  ea^lanatory  variables  used  in  the  analysis  below.  The 
next  section  of  this  chapter  describes  the  dependent  measures 
cmd  the  specifications  of  the  models  to  be  estimated. 


The  data  discriminates  only  between  fully- funded  and  non- 
funded  graduate  educated  officers,  and  since  non-funded  graduate 
educations  are  obtained  at  no  cost  to  the  Navy,  it  was  decided  to 
restrict  the  treatment  group  to  fully- funded  graduate  educated 
officers. 
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TABLB  Z.  DISCRIPTZQH  OF 


SPCTKSP 


LPCTREP 


cxmassioaxBs 


DEMGRAPBICS 


SEX 


MINORITY 


AC^NON 


MARONLY 


MARCHILD 


DIVCHILD 


SINGLE 


NUC 


NOCCXfBAT 


HISLROTC 

a  1  if  coBBiissianed  through  ROTC  at  a  "most”, 
"highly",  or  "very"  caeapetitive  undergraduate 
school 

a  0  otherwise 

HISELOCS 

m  1  if  commissioned  through  OCS  and  attended  a 
"most",  "highly",  or  "very"  competitive 
undergraduate  school 
a  0  otherwise 

LOSLROTC 

*  1  if  commissioned  through  ROTC  at  an 
undergraduate  school  not  ranked  above 
cospetitive 
a  0  otherwise 

LOSELOCS 

m  1  if  comnissioned  through  OCS  and  attended  em 
undergraduate  school  not  ranked  above 
coepetitive 
a  0  otherwise 

USNA 

m  1  if  commissioned  at  the  U.S.  Naval  Acadany 
a  0  otherwise 

NESEP 

a  1  if  commissioned  by  the  Naval  Enlisted 

Service  Education  Program  through  OCS 
a  0  otherwise 

s  1  if  female 


1  if  black  or  other  than  white 


a  age  at  time  of  0-4  selection  board 


a  1  if  married  and  no  children 


M  1  if  married  with  children 


1  if  divorced/ separated  with  child 


s  1  if  never  been  married  or  divorced  and  no 
children 


s  1  if  designated  Nuclear  Power 


s  1  if  never  served  on  a  combatant/CRODES  ship 


56 


VMaXMBLK 


NODSPHD 


SOONDOAL 


EARSVO 


EARSOOtr 


BARTAO 


ACADEMIC  PROFILE 


MATHSKILL 


TECHSKILL 


ELIGCOER 


FT  OF 


FYSBS5 


FYSB8€ 


FTSBB? 


FYSB88 


FYSB89 


FYSB90 


TaSATMEMT  VARIABLE 


tnent  Head  School 


m  1  if  Snginoeriag  Officer  of  the  lAitcta 
lified 


m  1  if  Qualified  as  Tecticel  Action  Officer 


m  1  if  achieved  early  Surface  Marfare  Officer 
qualificetion,  before  the  0-3  proffioeiau  board 


m  1  if  achieved  early  Engineeriacf  Officer  of 
the  Mhfcch  qualification,  before  the  0-3 
oroaotion  board 


m  1  if  achieved  early  qualification  as  Tactical 
Action  Officer 


undergraduate  grade  point  average  where;  OmO- 
1.89,  1*1.9-2.19,  2m2.2-2.S9,  3m2.6-3.19, 
4m3.2-3.59,  Sm3.€-4.0 


where  O^no  math,  l*pre-calc,  2>two  pre-calc 
with  B  avg,  3mcalc  with  C  avg,  4mtwo  calc  with 
C+  avg,  Smtwo  calc  with  B+  avg,  Smsig  post-calc 
with  B+  avg 


a  aunber  of  EPS  curricula  eligible,  ranging 
from  0  to  29 


=  1  if  0-4  selection  board  was  in  fiscal  year 
1985 


^  1  if  0-4  selection  board  was  in  fiscal  year 
1986 


*  1  if  0-4  selection  board  was  in  fiscal  year 
1987 


a  1  if  0-4  selection  hoard  was  in  fiscal  year 
1988 


s  1  if  0-4  selection  board  was  in  fiscal  year 
1989 


a  2  if  0-4  selection  board  was  in  fiscal  yesuc 
1990 


a  I  if  has  fully- funded  graduate  education 
degree  from  UPS  or  Navy  sponsored  civilian 
institution 
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B.  MBTHQDOLOOT 


The  purpose  of  this  thesis  Is  to  determine  the  Ixi^ct  of 
fully- fiinded  graduate  education  on  three  measures  of 
performance:  (l)  promotion  to  0-4  (yes-no) ,  (2)  percent  RAP 
of  LT  FITREPs,  and  (3)  RAP  of  last  LT  FITREP  prior  to  the  0-4 
board  (yes -no)  .  Because  selection  for  FF6E  Is  based  on 
estcUalished  criteria.  It  Is  not  the  result  of  a  reuidom 
process.  As  discussed  in  the  literature  review  in  Chapter  II, 
non- random  selection  into  any  treatment  introduces  the 
potential  for  bias  when  atten^tlng  to  estimate  the  effects  of 
being  in  the  treatment  group.  Thus,  it  is  Inperatlve  to  be 
able  to  predict  FF6E  selection  with  sufficient  accuracy  to 
obtain  relled)le  correction  factors  to  control  for  selection 
bias  In  the  performance  models. 

Selection  for  fully- funded  graduate  education  euid  the 
three  measures  of  perfomicuice  are  the  dependent  variables  of 
the  four  main  statistical  models  specified  and  estimated  in 
this  study.  Table  II  provides  a  conqplete  description  of  the 
definitions  of  the  dependent  variables  used  in  the  models. 

For  each  performance  measure,  four  different  model 
specifications  are  estimated.  These  are  designed  to 
demonstrate  the  marginal  effect  of  FFGE  on  performance  where 
different  controls  are  introduced.  The  first  specification 
measures  the  marginal  effect  of  fully- funded  graduate 
education  with  no  controls;  the  second  specification  measures 
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this  effect  with  observed  control  factors  Included  in  the 
equation.  The  third  and  fourth  specifications  apply  two 
alternative  techniques  to  correct  for  the  presence  of 
selectivity  bias. 


TABLE  II.  DESCRIPTION  OF  DEPEEDEET  VARIABLES. 


VMRIABLS 

DESCSXPTim 

SSLKCTXOi  HODSL 

FFGE 

m  1  if  ba.B  fully^ funded  graduate  education 
degree  from  EPS  or  Eavy  aponaored  civilian 
institution 

M  0  Otherwise 

PKBFOmaiUCB  MODELS 

PROMOTE 

a  1  if  promoted  to  0~4  early  or  "in  zone" 
s  0  otherwiae 

LPCTRSP 

«  percent  of  all  LT  FITRSPa  receiving 
"recoaaaended  for  early  promotion" 

LASTLTRP 

at  1  if  laat  LT  FITREP  prior  to  0-4 
aelection  board  received  "recommended  for 
early  prcanotion" 
m  0  otberviae 

Figure  4  illustrates  the  methodology  used  for  the 
selection  model  and  for  the  four  model  specifications  for  each 
of  the  three  performance  models.  Each  model  and  specification 
will  be  discussed  in  the  order  presented  in  Figure  4. 

1 .  Selection  Model 

The  Chief  of  Naval  Operations  (CNO)  states  that 
"selection  for  Navy  funded  graduate  education  will  be  based  on 
academic  capability,  outstanding  professional  performance, 
promotion  potential  and  a  strong  educational  background. " 
[Ref.  3,  p.  2]  This  reflects  the  criteria  applied  by  the  Navy 
in  selecting  candidates  for  graduate  studies.  In  addition. 
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miBcnmjesMi  ^ 

FWa  m  t(T) 


MTR  ttnmnjt 


1.  roaau.  smcr* 

PEBF,  «  £rKFCS; 

2.  omirT  wmr  fmfnannm  vjlciobs  ^ 

mF,  -  t(FF(X.  X) 

3.  maaan  aPPcnarg 

Stage  1:  Probit  to  obtain  correction 
factor,  UUIBDA. 

Stage  2;  flEKP,  -  £_(FPGB,  X,  TJUmiM) 

4.  aMBar  APatQifg  * 

Stage  1;  Probit  to  obtain  PBMT. 

Stage  2  s  PKBP,  >  Ifx,  PBU*; 


Y  repreaentB  a  vector  of  eiqplanatory  variablea. 

^  The  i  performance  measures  are: 

EJISTLISP. 


paamyxs,  lpcxbsp,  anc 


X  represents  a  vector  of  explanatory  variables, 

^  PBAT  is  the  probability  of  FFGE  selection  for  each 
officer. 


Figure  4.  Methodology  used  in  obtaining  estimates 
for  the  Selection  Model  and  the  three  Performance 
Meastire  Models. 


the  decision  to  apply  for  and  undertake  graduate  studies  is  a 
personal  decision,  which  therefore  involves  a  degree  of  self- 
selection.  The  specification  of  the  fully- funded  graduate 
education  selection  model  attenpts  to  capture  both  sources  of 
selection; 

FFGE  =  f(GPA,  MATHSKILL,  TBCHSKILL,  EPCTREP,  ELIGCDRR, 

EARSWO,  EAREOOW,  EARTAO) 

where  all  variables  were  defined  in  Table  I. 
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"Academic  capability"  amd  "a  strong  educational 
background"  were  captured  by  four  esq^leuiatory  variables.  The 
variables,  GPA,  MATHSKILL,  and  TBCHSKILL  are  combined  to 

determine  one's  Academic  Profile  Code  (APC) ,  a  three-digit 

/ 

number  indicating  academic  exposure  and  performance, 
specifically  in  math  and  science.  The  APC  is  the  sole  factor 
in  determining  academic  qualifications.  [Ref.  17]  An 
additional  variable,  ELI6CURR,  delineates  the  strength  of  cm 
officer's  APC  by  indicating  how  many  NPS  curricula  one  is 
eligible  for. 

Selection  for  fully- funded  graduate  education  occurs 
at  the  0-3  promotion  board.  Consequently,  criteria  for 
"outsteuidlng  professional  performance"  and  "promotion 
potential"  are  captured  by  variables  indicating  early  FITREP 
performance  and  whether  or  not  an  officer  achieved  early 
qualifications  in  SWO,  EOOW,  or  TAO.  Inclusion  of  the  early 
qualification  varicdsles  also  seemed  to  be  plausible  proxies 
(substitutes)  for  unobserved  factors,  such  as,  motivation, 
desire  for  achievement,  hard  working,  and  confidence,  so  often 
associated  with  those  possessing  a  graduate  degree.  As 
discussed  earlier,  failing  to  account  for  these  factors  could 
bias  the  estimated  effect  of  FFGE  on  performance. 

Since  FFGE  is  a  binary  variable,  it  is  modeled  using 
a  nonlinear  maximum- likelihood  probit  procedure,  which 
constrains  the  predicted  values  to  the  measured  unit  interval 
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of  0  to  The  FFGE  selection  problt  estimates  the  In^ct 
of  each  explanatory  varledale  on  the  likelihood  of  selection 
for  FFGE  and  confutes  predicted  probabilities  of  selection  for 
each  officer.  The  goal  would  be  to  have  the  model  correctly 
predict  a  high  proportion  of  observations,  since  this  model 
will  play  an  Integral  role  In  determining  the  presence  of 
selectivity  bias. 

2 .  Promotion  Model 

The  first  dependent  performcmce  measure  Is  a  binary 
varlcUDle  (PROMOTE-1,  else-0) ,  Indicating  whether  am  officer 
promoted  to  0-4  early  or  "In  zone"  (l.e.,  selected  before  or 
during  their  first  year  of  eligibility) .  Officers  selected 
late  were  not  considered  promotions  In  this  study,  since  they 
had  failed  to  promote  once  already.  Each  of  the  four 


The  probit  uses  the  normal  Cumulative  Distribution 
Function  (CDF)  in  estimating  the  model.  Assume  we  let  Y»1  if  the 
officer  attained  FFGE,  and  Y-0  If  the  officer  did  not.  There  Is  an 
unobservable  critical  threshold  level  index,  call  it  1^*,  such  that 
if  li  exceeds  1^*  the  officer  will  attain  FFGE,  otherwise  he/she 
will  not.  Given  the  assun^tion  of  normality,  the  probability  (P^) 
that  li*  is  less  than  or  equal  to  is  confuted  from  the 
standardized  normal  CDF  as: 

Pi=Pz{Y=l)  =Pr(lUlj)  =F(J_£)  dt=^^  dt 

where:  t  is  a  standard  normal  variable  and 

X  represents  a  vector  of  explanatory  variables. 

Here,  the  probability  of  attaining  FFGE  is  measured  by  the  area 
of  the  standard  normal  curve  from  -w  to  I^.  [Ref.20:p.  492] 
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promotion  specifications  obtain  parauneter  estimates  by 
applying  maocimum  likelihood  technic[ues  to  a  logit  imxlel.^* 
a.  Total  Effect  of  FFGB  t 

This  model  treats  FF6E  as  if  it  was  the  only 
determinamt  of  promotion  to  0-4.  This  is  a  "naive"  model  in 
the  sense  that  it  omits  all  other  factors  that  might  affect 
promotion,  amd  thus  illustrates  the  total  in^ct  of  FF6E  on 
the  likelihood  of  promotion.  However,  it  is  clear  that 
attainment  of  fully- funded  graduate  education  is  not  the  only 
contributing  factor  to  promotion.  There  are  other  factors 
that  affect  promotion  amd  that  have  an  indirect  impact  on 
whether  or  not  an  officer  has  FF6E.  This  model  merely 
estaUblishes  that  there  is  a  relationship  between  promotion  amd 
FFGE. 


The  logit  uses  the  logistic  Cumulative  Distribution 
Function  to  estimate  a  model.  If  Y»1  means  that  an  officer  was 
promoted  to  0-4  and  represents  a  vector  of  explanatory 
variables,  then  the  probaibility  that  an  officer  will  promote  to  0-4 
(P^)  can  be  represented  by: 

l+e 


where:  =  /3j^  +  jSiXji. 

This  formulation  allows  Z^  to  range  from  -»  to  +«,  while  P^  is 
restricted  between  0  and  1  and  is  nonlinearly  related  to  Z^. 
Although  the  probit  and  logit  formulations  provide  quite  similar 
results,  the  chief  difference  is  that  the  probit  normal  curve 
approaches  its  limits  (0,1)  quicker  than  the  logit  curve.  The 
choice  between  the  two  is  one  of  mathematical  convenience  and 
availability  of  computer  programs.  In  general,  the  logit  model  is 
normally  preferred  to  the  probit.  [Ref.  20:pp.  481-496] 
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b.  Kffect  of  tatb  ObBOTvod  FbctozB 

The  purpose  of  this  model  Is  to  Illustrate  the 
change  in  the  in^ct  of  fully*  funded  ^graduate  education  on 
promotion  when  other  determinants  of  promotion  are  included. 
The  other  determinauits  are  described  as  "observed"  because 
they  conqprise  information  readily  avallad)le  to  promotion 
selection  boards.  The  specification  of  this  model  is  as 
follows: 

PKOMOn  -  f(FFaB,  BPCTRSP,  LPCTRBP,  OPA,  HISLROTC,  HISBLOCS, 
LOSLROTC,  LOSBLOCS,  NBSBP,  FBMAIiB,  MINORITY, 

AOBNOW,  MRR0I1I.Y,  MARCHILD,  DIVCHILD,  NDC, 

NOCOMBAT,  NCmSPHD,  BARSWO,  BOONQOAL,  TACQUAL, 
FYSB85,  FYSB88,  FYSB87,  FYSB88,  FySB89) . 

Because  each  of  the  determinants  are  correlated, 
mecuiing  they  intact  one  cinother  indirectly,  the  estimate  of 
FF6E  in  this  specification  represents  the  direct  impact  on 
promotion. 

The  FITREP  performance  variables  are  used  to 
control  for  eui  officer's  evaluated  perfortncuice  prior  to  the  O- 
4  promotion  board,  and  as  expected,  plays  a  major  role  in 
determining  the  probability  of  promotion.  Other  factors 
included  in  this  specification  that  may  effect  the  likelihood 
of  promotion  are  commissioning  source  by  undergraduate  college 
selectivity,  various  demographic  characteristics,  the  degree 
of  Navy  experience,  and  the  fiscal  year  of  one's  selection 
board.  When  creating  dximny  variables,  it  is  necessary  to  omit 
one  of  the  conditions  from  the  regression  so  comparisons  cem 
be  made.  Therefore,  USNA  is  the  omitted  condition  within 
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conmisslonlng  source,  SHIGLB  is  omitted  from  marital  status, 
and  FYSB90  from  fiscal  year  of  0-4  promotion  board.  It  is 
expected  that  the  estimate  of  FFGB  will  be  considerably  less 
significant  than  the  total  effect  after  accovinting  for  these 
factors . 

Although  the  results  of  this  model  will  provide  a 
respectcdsle  estimate  for  FFGE  on  promotion,  the  issue  of 
exactly  what  maJces  an  individual  with  fully- funded  graduate 
education  more  promotad)le/productive  is  a  bit  more  ambiguous. 
It  may  be  that  the  virtual  knowledge  smd  responsibility  gained 
through  graduate  education  causes  am  increase  in  productivity 
or,  those  selected  for  graduate  education  may  already  be  more 
productive  due  to  innate  characteristics  that  maUce  them  more 
motivated  amd  hard  working.  If  the  latter  is  true,  the 
potential  for  selectivity  bias  exists  amd  failure  to  account 
for  these  innate  characteristics  may  cause  the  coefficient  for 
FFGE  to  be  overestimated.  There  are  estaUslished  procedures 
designed  to  Introduce  these  In:  characteristics 

(imobservables)  into  the  regression  equation  to  obtain  am 
unbiased  estimate  of  the  treatment  (FFGE)  effect, 
c.  Heckman  Approach 

One  way  to  determine  and  correct  for  selectivity 
bias  is  based  on  a  two- stage  procedure  developed  by  James 
Heckman,  described  in  Chapter  II.  The  first-stage  employs  the 
selection  probit  model  to  calculate  a  correction  factor,  which 
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incorporates  both  the  unobserved  factors  (contained  in  the 
error  structure  of  the  model)  and  the  probabilities  of 
selection  for  FFGE  associated  with  each  officer  in  a  term 
called  LAMBDA.  The  second- stage  calls  for  running  the  same 
model  used  in  specification  (b.)  with  the  addition  of  LAMBDA 
in  the  equation.  The  intent  is  to  purge  any  correlation 
between  the  treatment  effect  (PFGB)  and  the  error  term  by 
introducing  part  of  this  error  structure  into  the  model.  The 
resulting  sign  and  significance  of  LAMBDA  will  determine  the 
extent  of  selection  bias  and  Isolate  the  true  impact  of  FFGE 
on  promotion. 

d.  Bamcmr  Approach 

A  second  method  to  accoimt  for  selectivity  bias  is 
based  on  another  two- stage  procedure,  developed  by  Burt 
Bamow,  also  described  in  Chapter  ZX.  This  procedure  is  less 
enconpassing  than  Heckxnoui's  cmd  focuses  on  removing  any 
correlation  between  the  treatment  variable  (FFGE)  and  the 
dependent  measure  (PROMOTE) .  This  condition  of  causality  is 
called  endogeneity  and  is  a  distinct  possibility  in  this 
study,  since  95  percent  of  those  with  FFGE  were  promoted. 

The  first -stage  enploys  the  selection  model  probit, 
but  in  this  case,  only  the  probcQjilities  of  selection  into 
FFGE  associated  with  each  officer  are  retained  in  a  term 
called  PHAT.  The  second- stage  uses  the  same  model 
specification  in  (b.)  with  the  exception  of  substituting  PHAT 
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for  FF6E.  Restricting  the  xneasxire  of  fully- fvmded  graduate 
education  on  promotion  to  the  probaJslllty  of  attainment 
attenqpts  to  remove  emy  endogeneity,  thus  providing  a  more 
accurate  measure  of  the  In^ct  of  FF6E  through  PHAT. 

3.  Percent  SAP  of  LT  FZTSSPs  Model 

A  continuous  dependent  variable,  LPCTREP,  Is  used  as 
a  second  measure  of  performaince.  This  measure  was  derived 
from  cm  Identical  perfortaance  Index  developed  by  Idell  Neumazm 
at  NPRDC.  [Ref.  10]  As  discussed  In  the  previous  data 
section,  the  dependent  measure  represents  the  proportion  of 
all  LT  FITREPs  that  received  a  recommendation  for  early 
promotion.  The  Intent  of  this  measure  Is  to  capture  post¬ 
graduate  education  performance  and  determine  If  fully- fimded 
graduate  education  does  In  fact  enhance  the  aUslllty  to  perform 
at  a  higher  level.  Since  the  dependent  varlad>le  Is  linear, 
ordinary  least  squares  (OLS)  Is  used  In  obtaining  parameter 
estimates  In  all  specifications. 

a.  Total  Effect  of  FFGS 

This  specification,  with  FF6E  as  the  only 
explanatory  variable,  ested)lishes  the  total  inpact  of  fully- 
funded  graduate  education  on  the  percentage  of  LT  FITREPs 
receiving  an  early  recommendation  for  promotion.  A 
significant  positive  estimate  of  FFGE  simply  means  that  there 
is  a  positive  relationship  between  early  promotion 
recommendations  and  fully- funded  graduate  education 
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attainment.  However,  there  are  other  obeervcKi  factors  that 
must  be  considered  to  further  esqplaln  early  promotion 
recommendations .  i 

b.  Effect  of  FFGB  With  Observed  Factors 

Since  LPCTREP  Is  used  as  one  of  the  factors  to 
explain  promotion  to  0-4  and  the  same  sanple  population  Is 
used  In  this  model,  mamy  of  the  same  ea^lanatory  varlcQsles 
used  In  the  promotion  model  are  used  to  esqplaln  early 
promotion  recommendations.  The  specification  takes  the 
following  form: 

LPCTUP  -  £(FFGB,  bpctrbp,  opa,  hislrotc,  hisblocs,  loslrotc, 

liOSBlOCS,  MBSBP,  FBUALB,  MmORTIT,  AGBNOW, 

MARONLY,  MARCHILD,  DIVCHILD,  MDC,  NOCOBffiAT, 

NODBPHD,  BARSWO,  BOOItgDAL,  TAOgOAL)  . 

Since  LPCTREP  Is  the  dependent  measure.  It  Is 
removed  from  the  right  hcuad  side  and  since  the  fiscal  year  of 
selection  board  has  no  effect  on  FITREP  performance,  FYSB85- 
FYSB90  are  omitted  from  this  model.  As  In  the  promotion 
model,  determlncuits  are  correlated  to  each  other,  so  this 
specification  will  reveal  the  direct  inpact  of  FFGE  on 
LPCTREP. 

c.  Heckman  Approach 


The  same 

two- stage 

procedure 

discussed 

in 

the 

promotion  model  Is 

used  here 

with  the 

exception 

of 

the 

dependent  performance  measure  (LPCTREP) . 
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d.  BazBotr  Approach 


This  is  identical  to  the  two- stage  procedure  used 
in  the  promotion  model,  except  for  the  dependent  performance 
measure  (LPCTREP) . 

4.  Last  LT  FZTSBP  RAP  Modal 

A  binary  dependent  variable,  LASTLTRP,  is  used  as  the 
third  and  final  performamce  measure.  It  is  based  on  a  FITREP 
performance  index  developed  by  William  Bowman  of  the  U.S. 
Naval  Academy.  [Ref.  Ill  The  dependent  measure  indicates 
whether  or  not  the  officer  received  am  early  recommendation 
for  promotion  on  their  last  LT  FITREP  prior  to  the  0-4 
promotion  selection  board  (LASTLTRP-1,  else-O) .  This  last 
FITREP  is  considered  critical  since  it  completes  a  trend  of 
either  declining  or  in5)roving  performance,  unless  of  course 
the  officer  received  early  recommendations  on  all  FITREPs. 

The  objective  here  is  similar  to  the  two  previous 
perf  ormcuice  measures  -  -  to  determine  the  extent  to  which 
fully- funded  graduate  education  explains  receiving  an  early 
promotion  recommendation  on  the  last  LT  FITREP.  Since  the 
dependent  measure  is  binary,  nonlinear  logit  models  are  used 
to  obtain  parameter  estimates  in  all  four  specifications. 
Since  this  measure  is  also  derived  from  FITREPs,  the 
specification  is  identical  to  that  used  in  the  LPCTREP  model. 
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a.  Total  Ettact  of  FFQE 

With  FFGE  as  the  only  e:q)lanatory  varladjle,  this 
specification  Illustrates  the  total  inpact  of  fully- funded 
graduate  educated  officers  on  whether  or  not  the  last  LT 
FITREP  Is  recommended  for  early  promotion.  This  specification 
establishes  the  Initial  relationship  between  FFGE  and 
LASTLTRP. 

b.  Effect  of  FFGE  With  Observed  Factors 

Using  the  same  observed  factors  as  the  percent  RAP 
of  LT  FITREPs  model,  this  specification  determines  the  direct 
inpact  of  FFGE  on  LASTLTRP  when  adding  other  observed  factors. 
Accounting  for  these  other  determinants  of  LASTLTRP  emd 
because  these  other  observed  factors  also  have  an  indirect 
Impact  on  FFGE,  the  estimate  of  FFGE  is  expected  to  be 
considerably  less  than  was  foxmd  in  the  total  effect 
specification. 

c.  Heckman  J^jproacb 

This  is  identical  to  the  two- stage  Heckmaui 
procedure  described  in  the  promotion  model ,  with  the  exception 
of  the  dependent  performance  measure  (LASTLTRP) . 

d.  Bamaw  Approach 

This  is  identical  to  the  two- stage  Bamow  procedure 
described  in  the  promotion  model,  with  the  exception  of  the 
dependent  performance  measure  (LASTLTRP) . 


70 


By  now.  It  should  be  obvious  that  the  selection  model 
plays  a  slgnlflcemt  role  In  detexmlnlng  selection  bias. 
Essentially,  the  procedures  used  to  account  for  selectivity 
bias  will  only  be  as  effective  as  the  eUslllty  to  accurately 
predict  fully- funded  graduate  education  selection.  However, 
a  potential  problem  already  eidsts  In  that,  just  because  one 
Is  selected  for  FFGE  does  not  necessarily  meaui  he  or  she  will 
choose  to  pursue  it.  The  data  only  reflects  those  selectees 
who  elected  to  attain  fully- funded  graduate  education; 
officers  meeting  the  minimum  academic  and  performeuice  criteria 
electing  not  to  attend  FFGE  are  considered  " non- selects. " 

A  final  Issue  deserving  of  some  attention  deals  with  an 
additional  level  of  selectivity.  The  Selectivity  Bias  section 
In  Chapter  II  addresses  a  potential  limitation  of  the  Heckman 
procedure  If  there  exists  other  types  of  selection,  preceding 
the  one  in  question,  that  may  effect  the  outcome  of  the  main 
equation.  An  officer's  decision  whether  to  stay  or  leave  the 
service  at  the  coirpletion  of  his/her  initial  tour  of 
obligation  Is  a  selection  issue  that.  In  most  cases,  precedes 
selection  for  fully- funded  graduate  education;  the  factors 
explaining  this  separation  behavior  may  help  to  explain 
promotion  and  performance.  Hence,  it  would  seem  that  a  dual 
selection  approach,  including  both  separation  and  fully- funded 
graduate  education  selectivity  issues  is  required.  The 
specification  of  the  separation  model  focuses  on  varicdjles 
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that  might  help  to  explain  an  officer's  decision  to  stay  or 
leave  early  In  one's  career: 

SIP  >  f  (BPCTRBP,  GPA,  HISLROTC,  HZSBliOCS,  LOSLRDTC, 
lOSBlOCS,  KBSBP,  FBMALB,  MUSORITY,  ASBNOH, 

MARCBILY,  HARCKILD,  DIVCHILD,  NDC,  NOCGHBAT, 

BARSBO,  BARBOOW,  BARTAO) . 

A  nonlinear  probit  with  a  binary  dependent  variable 
(SEP-1,  else-O)  was  used  to  obtain  an  additional  correction 
factor  to  accoimt  for  potential  selectivity  bias  associated 
with  separation  behavior.  A  Heckmaui  procedure  with  correction 
factors  for  both  separation  and  FF6E  selection  (LAMBDAl, 
LAMBDA2)  was  run  for  each  performance  measure  to  determine  the 
intact  with  the  additional  level  of  selection.  Although  this 
selectivity  issue  is  important,  the  results  are  provided  in 
the  Appendix  since  the  differences  between  using  this  multiple 
selection  approach  and  the  single  selection  (just  PFGB)  were 
minixnal. 
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IV.  SKPZKICAL  ANALYSIS 


A.  BIVARIATE  ANALYSIS 

This  section  cuialyzes  the  scuiple  of  1,477  SWO's  extracted 
from  the  two  original  data  sources.  Since  the  focus  of  this 
study  is  on  officers  with  fully- fimded  graduate  education,  it 
is  useful  to  examine  the  means  of  the  three  dependent 
variables  (performance  measures)  and  of  each  explanatory 
variable  for  the  full  sample,  and  subsan^les  of  those  with  and 
without  FFGE.  Table  III  displays  variable  means  (and  stamdard 
deviations)  for  three  groups:  (1)  those  with  fully- funded 
graduate  education;  (2)  those  without  fully- funded  graduate 
education;  and  (3)  the  full  sample. 

Table  III  indicates  significant  differences  in  the 
attributes  of  those  with  euid  without  FFGE.  Analysis  of  these 
differences  may  help  identify  which  variables  are  likely  to 
have  an  impact  on  selection  for  fully- funded  graduate 
education. 

Analysis  of  the  characteristics  of  the  full  sample 
reveals,  for  example: 

•  81.5  percent  promoted  to  0-4 

•  71  percent  of  all  LT  FITREPs  received  early  promotion 
recommendations 

•  82.9  percent  received  an  early  promotion  recommendation  on 
the  last  LT  FITREP 
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•  37  percent  of  all  early  (ENS/LTJG)  FITREPs  were 
reccrmnended  for  early  promotion 

•  30.3  percent  were  USNA  graduates,  the  most  frequent 
commissioning  source 

•  over  90  percent  were  male  and  white 

•  the  average  age  t«as  32 

•  over  one-half  (52.1  percent)  were  married  with  children 

•  over  90  percent  had  served  on  a  CRUDES  ship 

•  74  percent  had  attended  Department  Head  School 

•  the  majority  were  not  EOOW  or  TAO  qualified,  but  57.3 
percent  had  received  cm  early  SWO  qualification 

•  the  average  undergraduate  6PA  ranged  between  2.6  and  3.19 

•  an  officer  was  eligible  for  am  average  of  10  curricula  at 
NPS 

•  were  evenly  distributed  across  fiscal  year  promotion 
boards  for  0-4 

•  and  nearly  one- fifth  had  conpleted  a  fully- funded  graduate 
education  by  the  time  they  were  in  zone  to  be  considered 
for  0-4. 

The  mecui  values  of  the  performance  measures  by  group 
displayed  in  Figure  1  of  Chapter  I  indicated  sizeable 
differences  in  performauice  in  favor  of  FFGE  officers.  The 
performouice  measure  differences  suggest  that  having  FFGE  has 
the  largest  effect  on  whether  or  not  one  gets  promoted  to  0-4, 
as  95  percent  of  the  officers  with  FFGE  were  promoted  compared 
to  only  78  percent  of  the  officers  without  FFGE.  The  means 
(in  Table  III)  of  the  other  two  FITREP  performance  measures 
(LPCTREP  and  LASTLTRP)  also  indicates  better  performance  by 
officers  with  FFGE;  the  latter  outperformed  officers  without 
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FFGE  by  10  aind  5  percentage  points  on  these  two  measures 
respectively. 


TABLE  ZZZ.  MEANS,  PROPOETZONS,  AND  STANDARD  DEVZATZONS  OF 
PERFORMANCE  MEASURES  AMD  EXPLENATORT  VARZABLES  FOR  THREE 
SAMPLES. 


MEAN 

(STANDARD  DEVIATION) 

VaRIABLKS 

MSSM 

iro 

PFGB 

- 1 

AT.T. 

SAMPLE 

(N«282} 

1  (N. 

1,195) 

(N- 

1,477) 

PBRPOIiiaMCB  MBaSURBS 

PRObfOTE 

.950 

(.218) 

.783 

(.412) 

.815 

(.388) 

LPCTRBP 

.795 

(.260) 

.696 

(.281) 

.715 

(.279) 

LASTLTRP 

.8S5 

(.342) 

.820 

(.384) 

.829 

(.377) 

PITRBP  PBRFOSMaHCB 

BPCTRBP 

.509 

(.360) 

.334 

(.369) 

liPCTRBP 

.795 

(.260) 

.696 

(.281) 

.715 

(.297) 

COMMISSiaSIHQ  SODRCB 

HISLROTC 

.163 

(.370) 

.168 

(.374) 

.167 

(.373) 

KISBLOCS 

.128 

(.334) 

.158 

(.365) 

.152 

(.359) 

lOSLROTC 

.138 

(.346) 

.117 

(.322) 

.121 

(.326) 

LOSBLOCS 

.167 

(.373) 

.274 

(.446) 

.253 

(.435) 

nSNR 

.400 

(.491) 

.280 

(.449) 

.303 

(.460) 

NESBP 

.004 

(.060) 

.003 

(.050) 

.003 

(.052) 

PBRSOKAL  DEMOGRAPHICS 

1 

FEMAI<E 

.028 

(.166) 

.018 

U131) 

.020 

(.139) 

MALE 

.972 

(.166) 

.982 

(.131) 

.980 

(.138) 

MINORITY 

.064 

(.245) 

.085 

(.278) 

.081 

(.272) 

AGENOW 

31.5 

(1.92) 

32.4 

(2.76) 

32.2 

(2.64) 

MARONLY 

.270 

(.445) 

.246 

(.431) 

.251 

(.433) 

MARCHILD 

.535 

(.500) 

.518 

(.500) 

.521 

(.500) 

DIVCHILD 

.012 

(.103) 

.023 

(.151) 

.021 

(.143) 

SINGLE 

.184 

(.389) 

.213 

(.410) 

.207 

(.405) 

NAVY  BZPBRIBNCB 

NUC 

.100 

(.295) 

.077 

(.267) 

.081 

(.272)  1 
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(SnUIDMU)  OSVIATKMI) 


1  vaaiABZiis 

FFSB 

BAMPXiB 

(H-282) 

HO  FFOB 
•  SAMPU 

’t(H>l,l95) 

AU 

1,477) 

NOCQUBAT 

.050 

(.216) 

.090 

(.287) 

.083 

(.275) 

NODBPHD 

.180 

(.367) 

.291 

(.456) 

.266 

(.442) 

BOONQOAL 

.535 

(.500) 

.463 

(.499) 

.477 

(.500) 

TAOQOAL 

.376 

(.485) 

.294 

(.456) 

.309 

(.462) 

BARSNO 

.677 

(.468) 

.548 

(.498) 

.573 

(.495) 

BARBOOW 

.174 

(.380) 

.091 

(.288) 

.107 

(.309) 

BARTAO 

.035 

(.182) 

.008 

(.086) 

.013 

(.113) 

ACADBMIC  PROFILB 

GPA 

2.76 

(.852) 

2.54 

(.936) 

2.58 

(.923) 

MATHSKILL 

3.57 

(1.09) 

2.82 

(1.55) 

2.96 

(1.50)  1 

TBCHSKILL 

1.68 

(1.37) 

1.10 

(1.33) 

1.21 

(1.36)  1 

BLIGCDRR 

11.9 

(9.29) 

9.97 

(8.39) 

10.3 

(8.60)  1 

FT  OF  0-4  SBLBCTZON  BOAKD 

FYSB85 

.043 

(.202) 

.056 

(.230) 

.053 

(.225) 

FYSB86 

.181 

(.386) 

.198 

(.399) 

.195 

(.396) 

FYSB87 

.234 

(.426) 

.182 

(.386) 

.192 

(.394)  1 

FYSB88 

.153 

(.360) 

.136 

(.343) 

.139 

(.347)  1 

FYSB89 

.188 

(.391) 

.236 

(.425) 

.227 

(.419)  1 

FYSB90 

.199 

(.400) 

.192 

(.394) 

.193 

(.395)  1 

TRBATKBNT  VARIABLB 

FFGB 

-- 

.... 

-- 

.191 

(.393) 

Table  III  further  reveals  that  performance  on  ENS/LTJG 
FITREPs  (EPCTREP)  may  be  an  important  factor  in  FFGE 
selection,  since  those  who  ultimately  were  selected  for 


I 

I 

graduate  education  were  more  likely  to  have  been  recommended 
for  accelerated  promotion  on  their  early  FITREPs.  Mean  values 
of  commissioning  source  and  college  quality  reveal  that  Naval 
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Academy  graduates  are  the  most  likely  to  be  selected  for  FFGE, 
con^rising  40  percent  of  the  siibsample  of  officers  with  FF6E 
and  only  28  percent  of  those  without.  OCS  comnlssloned 
officers  from  lower  quality  colleges  (LOSELOCS)  are  least 
likely  to  be  selected,  comprising  only  16.7  percent  of  those 
with  FF6E  and  27  percent  of  those  without.  Although  fexnales 
comprise  only  2  percent  of  the  whole  sample,  they  represent 
2.8  percent  of  all  those  selected  for  FF6E,  suggesting  that  a 
greater  proportion  of  females  are  selected  for  fully- funded 
graduate  education.  A  lower  percentage  of  minorities,  2 
percentage  points  less,  are  selected  for  FF6E  compared  to 
those  without;  and  selection  for  FF6E  seeims  to  favor  officers 
who  are  married  (with  or  without  children)  compared  to  those 
who  are  divorced  or  single. 

As  mentioned  In  Chapter  III,  academic  experience  and 
professional  performance  are  Importauit  criteria  for  selection 
into  the  Navy's  FF6E  program.  Table  III  seems  to  support  this 
criteria  in  that,  among  FFGE  officers,  those  with  cui  early  SWO 
qualification,  an  early  EOOW  qualification,  and  an  early  TAO 
qualification  are  more  heavily  represented.  Furthermore, 
those  selected  for  FFGE  have  higher  averages  in  all  three 
Academic  Profile  Code  areas,  with  the  largest  difference  in 
math  skills,  and  are  eligible  for  an  average  of  two  more  NPS 
curricula  than  those  without  FFGE. 

The  increase  in  the  percentage  of  officers  selected  for 
FFGE  during  fiscal  year  promotion  board  1987  and  1988  most 
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likely  can  be  attributed  to  the  Increased  ^ophasls  In  graduate 
education  just  after  fiscal  year  1985,  when  the  Navy 
experienced  difficulty  meeting  graduate  education  cpiotas.^^ 
Cross -tedjulat Ions  of  esqplauiatory  variable  categories  by 
each  of  the  three  performsuice  measures  further  substantiates 
the  consistent  superior  performance  (In  promotion  euid 
percentage  of  LT  FITREPs  recommended  for  early  promotion)  for 
officers  with  fully- funded  graduate  education.  However,  the 
third  performcmce  measure.  Indicating  whether  or  not  the  last 
LT  FITREP  received  an  early  recommendation  for  promotion, 
seems  to  be  somewhat  Inconsistent  con^red  to  the  other  two. 
Ted}le  IV  Illustrates  performance  differences  between  those 
with  FF6E  and  those  without  for  each  performemce  measure  by 
commissioning  source,  personal  demographics,  euid  Navy 
experience . 

As  can  be  seen  In  TcJsle  TV,  officers  with  FF6E  generally 
tend  to  perform  better  In  promotion  euid  LPCTREP  regardless  of 
the  commissioning  source,  personal  demographics,  and  extent  of 
Navy  e3q)erlence.  Contrary  to  the  first  two  performance 
measures,  performance  on  the  LASTLTRP  seems  to  be  somewhat 
xinpredlctcd>le,  where  a  higher  percentage  of  officers  without 
FFGE  received  early  promotion  recommendations  on  their  last  LT 
FITREP  In  all  three  of  the  explanatory  variable  categories. 

In  the  Navy  Graduate  Education  Program  Status  Report  for 
FY  1984,  prepared  by  the  Naval  Postgraduate  School,  references  are 
made  to  the  chronic  difficulties  the  Navy  experienced  with  meeting 
graduate  education  quotas  between  years  1979  and  1983.  [Ref.  18] 
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This  could  that  using  a  single  FITREP,  regardless  of  how 
inqportauit  It  is,  may  not  be  as  reliable  or  encompassing  in 
evaluating  an  officer's  overall  performance. 


TABLE  IV.  PEKFOBIIANCB  DXFFBSBNCBS  BT  GRADUATE  EDUCATION 
ACROSS  COMmSSIONING  SOURCE,  PERSONAL  DEMOGRAPHICS,  AMD  MATT 
EXPERIENCE.  * 


VaRIABLK 

XEfiM 

PFcn 

OTE 

HO 

FPQB 

LPg 

PFOB 

OUl 

HO 

FTQB 

LASS 

FPOB 

TiTOP 

HO 

PFOB 

KISLROTC 

93.5 

77.1 

77.7 

67.5 

87.0 

80.1 

HISBLOCS 

94.4 

80.42 

81.2 

70.5 

80.6 

81.5 

LOSLROTC 

92.3 

77.1 

75.8 

66.0 

84.6 

82.1 

LOSELOCS 

91.5 

75.8 

72.2 

68.9 

76.6 

81.7 

NBSBP  ~ 

100.0 

66.7 

100.0 

58.2 

100.0 

100.0 

nsiu 

98.2 

80.9 

83.9 

72.8 

92.9 

83.6 

fbmalb  ** 

100.0 

90.5 

83.5 

•  2 

75.0 

81.0 

MALE 

94.9 

wm 

69.7 

82.0 

MmORITY 

88.9 

73.3 

83.3 

59.4 

94.4 

72.3 

WHITE 

95.5 

78.8 

79.2 

70.6 

86.0 

82.9  1 

HARONLY 

94.7 

77.2 

76.5 

71.1 

84.2 

87.1  1 

MARCHIU) 

95.4 

80.8 

82.5 

70.6 

91.4 

82.6  1 

DIVCHILD  ” 

100.0 

75.0 

86.7 

57.2 

100.0 

71.4 

SINGLE 

94.2 

74.0 

74.8 

66.9 

75.0 

76.0 

NDC 

100.0 

95.7 

78.9 

71.2 

85.2 

88.0 

NON-NDC 

94.5 

76.9 

79.6 

69.5 

86.7 

81.5 

NOCQMBAT 

100.0 

51.9 

82.9 

53.7 

85.7 

70.4 

COMBAT 

94.8 

81.0 

79.3 

71.2 

86.6 

83.2 

NODEPHD 

93.3 

52.6 

77.3 

57.7 

80.0 

70.1 

DEPHD 

95.4 

88.9 

79.9 

74.5 

87.8 

86.9 

BOOWCTOAL 

96.7 

89.0 

85.0 

76.0 

91.4 

89.0 

NOBOOWQOAL 

93.1 

69.2 

73.2 

64.2 

80.9 

76.0 

79 


VARZABU 

PROMOCT 

■0 

PPCB  FFOR 

ItiSUEU 

■0 

FPOR  PPOR 

TAOQOAL 

100.0 

90.9 

87.3 

79.7 

93.4 

92.3 

NOTAOQOAL 

92.1 

73.1 

74.8 

65.4 

82.4 

77.3 

1  BARSNO 

95.8 

83.4 

82.1 

76.2 

86.4 

84.4 

NOBARSWO 

93.4 

72.2 

74.1 

61.7 

86.8 

79.1 

BARBOOW 

91.8 

89.9 

81.9 

77.6 

85.7 

90.8 

NOEARBOOW 

95.7 

77.2 

79.0 

68.8 

86.7 

81.1 

BARZAO  ** 

100.0 

77.8 

100.0 

90.4 

100.0 

100.0 

ITOBARTAO 

94.9 

78.3 

78.8 

69.5 

86.0 

81.9 

All  figures  are  in  percentages. 

**  Observations  represent  less  than  3  percent  of  the  saaple. 


More  specifically,  Tcdale  IV  Illustrates  that  USNA 
graduates,  with  or  without  FTOE,  tend  to  perform  better  them 
ROTC  emd  OCS  commissioned  officers,  regardless  of 
undergraduate  college  quality.  This  holds  tiue  for  all  three 
performance  measures.  Additionally,  OCS  officers,  with  or 
without  PFGE  who  attended  a  highly  competitive  undergraduate 
college  seem  to  outperform  ROTC  officers  In  promotion  and 
LPCTREP;  however,  OCS  officers  who  attended  a  less  competitive 
college  tend  to  perform  the  worst  In  all  three  performcmee 
measures . 

Personal  demographic  characteristics  cross  -  tabulated  with 
performance  measures  reveal  that  females  with  or  without  FFGE, 
although  representing  only  2  percent  of  the  sample,  tend  to 
outperform  males  with  and  without  FFGE  In  promotion  by  5  and 
12  percentage  points,  respectively.  In  the  LPCTREP  measure. 


80 


females  with  FF6B  outperform  males  with  FF6E  by  4  percentage 
points.  However,  males  with  or  without  FF6E  seem  to  fare 
better  in  the  LASTLTRP  performamce  measure.  The  cross - 
tabulation  further  reveals  that  minority  Surface  Warfare 
officers  generally  perform  more  poorly  on  all  three 
performance  measures,  unless  he/she  has  FF6E;  minorities  with 
FFGE  outperformed  whites  with  FFGE  in  the  LPCTREP  euid  LASTLTRP 
performcince  measures.  Although  outside  the  scope  of  this 
thesis,  an  interesting  question  is  why  minorities  with  FFGE 
fail  to  promote  as  favoreUoly  as  whites  with  FFGE,  even  though 
they  maintain  higher  fitness  report  scores.  This  is  a  topic 
for  further  research.  Finally,  officers  married  with  children 
generally  perform  better  than  officers  married  with  no 
children,  divorced,  or  single. 

With  the  exception  of  fitness  report  performance,  the 
extent  of  one's  Navy  e3q)erience  is  probcQsly  the  most  revealing 
factor  in  each  performsmce  measure.  Tedale  TV  reveals  an 
interesting  trend  within  Navy  experience,  indicating  that 
certain  attributes  considered  as  career- enhcuicing  have  a 
stronger  effect  on  performance  measures  for  non- FFGE  officers 
than  for  FFGE  officers.  Non- FFGE  officers  having  one  or  more 
of  the  following  attributes  --  nuclear  power  trained,  served 
on  a  CRUDES  ship,  attended  Department  Head  school,  EOOW 
qualified,  TAO  qualified,  cUid  received  an  early  SWO,  ECX)W,  or 
TAO  qualification  --  averaged  at  least  10  percentage  points 
better  on  all  three  performance  measures  than  non- FFGE 


81 


officers  without  the  preceding  attributes.  On  the  other  luuxd, 
perfonn2uice  measure  differences  for  officers  with  FF6E 
possessing  career  enhancing  attributes  compared  to  those 
without  the  attributes  were  much  smaller  In  magnitude, 
suggesting  that  attainment  of  a  fully- funded  graduate 
education  may  condensate  for  failure  to  achieve  certain 
qualifications  and  experience  vital  In  a  Surface  Warfare 
officer's  career.  For  exandle,  non-FF6B  officers  who  attended 
Department  Head  school  promoted  34  percentage  points  higher 
theua  non-FFGE  officers  who  did  not  attend  Department  Head 
school,  while  FFGE  officers  with  Department  Head  school 
promoted  only  2  percentage  points  higher  them  FFGE  officers 
without  Department  Head  school.  Similar  differences  are 
evident  within  each  of  the  other  two  performance  measures  amd 
throughout  all  the  Navy  experience  varlod}les. 

In  concluding  the  bivariate  analysis,  Tables  III  amd  IV 
clearly  suggest  that  attainment  of  a  fully- fimded  graduate 
education  is  advamtageous  in  promotion  to  0-4  amd  contributes 
to  receiving  early  promotion  recommendations  on  LT  FITREPs. 
However,  the  iirpact  of  FFGE  on  receiving  am  early  promotion 
recommendation  on  the  last  LT  FITREP  is  questionaUble. 
Although  this  form  of  amalysls  is  suggestive,  in  order  to 
obtain  a  more  relieUDle  estimate  of  the  impact  of  fully- funded 
graduate  education  on  the  performance  measures,  one  must 
simultaneously  incorporate  the  effects  of  all  the  explanatory 
varicQsles  by  holding  each  constant.  A  more  advanced 
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statistical  technique,  multivariate  regression  analysis, 
enables  one  to  do  this  and  is  the  subject  of  the  next  section. 

% 

B.  MDLTZVARZATB  ANILYSZS 

Four  main  models,  discussed  in  the  methodology  section  of 
Chapter  III,  are  used  to  evaluate  the  impact  of  fully- funded 
graduate  education  on  Surface  Warfare  officer  performance. 
The  dependent  variable,  FFGE,  for  the  selection  model  is  coded 
■»l  for  those  with  fully- fvinded  graduate  education  and  «0 
otherwise.  Since  the  dependent  varicUsle  is  binary,  a  maocimum 
likelihood  technique  is  used  to  estimate  a  probit  model  of 
selection  for  fully- fxinded  graduate  education.  The  first 
performcuice  model  uses  the  "in- zone”  or  "below- zone"  promotion 
outcome  to  0-4  as  the  dependent  varieUble  and  is  estimated 
using  a  logit  model,  where  PROMOTE-1  for  those  who  are 
promoted  and  -0  otherwise.  The  second  performance  measure 
uses  the  percent  of  LT  FITREPs  receiving  an  early  promotion 
recommendation  (LPCTREP)  as  the  dependent  varicUsle.  Since  the 
dependent  variable  is  continuous,  the  model  is  estimated  using 
linear  ordinary  least  squares  (OLS)  regression  techniques. 
The  third  performance  measure  uses  the  recommendation  for 
early  promotion  on  the  last  LT  FITREP  as  the  dependent 
varisdjle.  This  dependent  varieible,  LASTLTRP,  is  coded  =1  if 
the  officer's  last  LT  FITREP  received  a  RAP  and  =0  otherwise. 
Since  the  dependent  variable  is  binary,  the  logit  technique  is 
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used  to  estimate  the  model. This  section  presents  the 
multivariate  results  of  the  selection  model  amd  the  three 
performcuice  models,  where  the  specifications  were  defined  in 
Chapter 

A  separate  toible  is  presented  for  each  estimated  model  auid 
displays  the  signs  auid  magnitudes  of  the  estimated 
coefficients,  the  t- statistics,  and,  for  the  nonlinear  models, 
the  chcuige  in  probabilities  associated  with  a  one  vinit  chamge 
in  each  explanatory  variaUsle;  holding  other  variadsles 
constant . 

1.  Estimates  of  the  Selection  Model 

As  was  discussed  in  Chapters  II  ctnd  III,  the  selection 
probit  is  vital  in  determining  the  presence  of  selectivity 
bias  associated  with  selection  into  the  Navy's  fully- funded 
graduate  education  progrcun.  The  problt  incorporates  the 
unobserved  factors  gathered  from  the  error  structure,  which  is 


Nonlinear  probit  or  logit  ftmctional  forms  are  superior  to 
linear  OLS  functions  when  the  dependent  variable  is  binary  because 
they  constrain  the  predicted  values  to  the  unit  interval  (0,1)  so 
that  the  expected  value  can  be  interpreted  as  the  probability  of 
the  event  occurring.  Although  both  nonlinear  functions  produce 
similar  results,  the  logit  is  preferred  since  it  is  easier  to 
interpret  cuid  convert  to  changes  in  probabilities.  [Ref.  19]  The 
probit  is  used  for  the  FFGE  selection  model  because  of  its  ability 
to  incorporate  unobserved  characteristics  -  -  hence  the  model  of 
choice  in  the  first  stage  of  the  two- stage  procedures  to  deal  with 
selectivity  bias. 

Willicun  H.  Greene's  Econometric  Software  package,  LIMDEP, 
was  used  to  obtain  estimates  for  all  models  in  this  thesis.  [Ref. 
15]  Greene  is  consider'ed  one  of  the  best  known  sources  for 
econometric  techniques  currently  "in  vogue." 
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based  on  the  calculated  probability  of  selection  into  FFGE 
associated  with  each  observation,  into  an  additional  term 
called  LAMBDA.^®  This  term  is  then  used  in  the  performance 
models  to  adjust  for  potential  selectivity  bias  in  the 
estimated  effect  of  graduate  education  on  performance. 

Table  V  displays  the  results  of  the  probit  selection 
model,  the  specification  of  which  was  expressed  mathematically 
in  Chapter  II.  The  specification  of  the  model  was  discussed 
further  in  Chapter  III.  In  TaO^le  V,  seven  of  the  eight 
variables  used  to  explain  FFGE  selection  were  statistically 
significemt.  The  positive  signs  of  the  significant  variables 
indicated  significaint  positive  inpacts  on  the  likelihood  of 
selection  for  fully- fxmded  graduate  education.  Out  of  the 
three  variaUoles  comprising  the  Academic  Profile  Code, 
performance  in  math  (MATHSKIL)  seemed  to  be  the  most 
inportant,  with  a  one  percent  increase  in  math  index  score 
increasing  the  probability  of  FFGE  attainment  by  4.4  percent. 
Performance  on  early  (ENS/LTJG)  PITREPs  and  attaining  an  early 
TAO  qualification  had  the  largest  impact  on  selection  for 
FFGE,  with  a  one  percent  increase  in  the  percent  of  early 
FITREPs  recommended  for  early  promotion  increasing  the 
probability  of  selection  by  10.8  percent;  an  officer  with  an 
early  TAO  qualification  was  16.8  percent  more  likely  to  be 
selected. 

See  Section  D  of  Chapter  II  for  mathematical 
interpretation  of  obtaining  LAMBDA. 
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TABLE  V.  PROBZT  ESTIMATES  OF  THE  SELECTION  MODEL.  ^ 


VARZABLB 

BSTXMATSD 

COBFPICIBNT 

(XANQB  IN 
PROBABILXTy  * 

GPA 

.110  (2.19)  * 

.027 

MATHSKIL 

.176  (4.79)  " 

.044 

TBCHSKIL 

.054  (1.51) 

.013 

BPCTRBP 

.439  (5.37)  " 

.108 

BLIGCORR 

.013  (2.65)  " 

.003 

BARSNO 

.264  (3.12)  " 

.065 

BARBOOW 

.307  (2.58)  " 

.076 

BARTAO 

.680  (2.19)  * 

.168  1 

XNTBRCBPT 

-2.36  (-12.43) 

1 

CHI -SQUARE  LOG  LIKELIHOOD 

149.88"  i 

PREDICTION  RATIO  ’ 

o 

CO 

*  t'Statistic  in  parentheses  measures  significance  of  coefficient. 

*  Calculated  by  multiplying  the  estimated  coefficient  by  the 
density  of  the  standard  normal  distribution  function  corresponding  to 
the  paurticular  probability  level,  as  given  by  the  cumulative  normal 
distribution  function  for  idiich  the  change  is  being  evaluated.  [Ref. 
19] 

’  Ratio  of  correct  predictions  over  total  nuiid>er  of  observations. 
Note :  98.6%  of  those  without  PPGB  were  correctly  predicted,  but  only 
6.7%  of  those  with  FFGB  were  predicted  correctly.  Additionally,  out 
of  the  actvial  19%  that  had  FFGB,  the  model  only  predicted  a  mere  2.4% 
to  have  FFGB. 

*  Significwt  at  the  .05  level. 

**  Significant  at  the  .01  level. _ 


In  evaluating  the  goodness -of -fit  of  the  model,  the 
chi-square  log- likelihood  statistic  is  used  to  test  a  null 
hypothesis  that  all  variables  are  simultaneously  equal  to 
zero.  Although  this  test  is  considered  weak  because  a  model 
rarely,  if  ever,  fails  to  meet  the  criteria,  the  Log- 
Likelihood  value  of  149.88  was  highly  significant  (at  the  .01 
level) ,  which  rejects  the  null  statistically  and  indicates 
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that  the  Included  variables  are  related  as  a  whole  to  FF6E 
selection. 

The  predictive  ability  of  the  model,  indicated  by  the 
prediction  ratio,  is  euiother  way  to  evaliiate  model  fit.  Since 
the  selection  model  correctly  predicted  81  percent  of  those 
with  and  without  FF6E,  the  model  appears  to  be  reasonably 
accurate.  However,  further  euoalysis  of  correct  prediction 
percentages  revealed  that  98.6  percent  of  those  without  FF6E 
were  predicted  correctly,  but  the  model  was  only  able  to 
correctly  predict  6.7  percent  of  those  with  FFGE.  Although  19 
percent  of  the  sanple  actually  had  FFGE,  the  model  predicted 
a  dismal  2.4  percent  to  have  FFGE.  These  poor  prediction 
percentages  may  reduce  the  effectiveness  of  the  procedures 
used  to  correct  for  potential  bias  associated  with  FFGE 
selection. 

While  the  variables  included  in  this  model  appear  to 
be  inportcuit,  we  still  do  not  know  how  accurate  this  selection 
model  is  as  a  representation  of  the  true  selection  process  via 
which  individuals  choose,  and  the  Navy  decides  to  assign 
individuals  to  graduate  education  programs.  In  particular, 
other  in^ortant  variables  relevant  to  the  selection  process 
are  likely  omitted,  which  could  bias  the  effect  of  the 
included  varicdales.  [Ref.  16]  The  key  issue  is  whether  the 
true  selection  process  has  been  captured  by  this  model . 
Unfortunately,  the  "true"  selection  model  is  unknown.  For  the 
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purposes  of  test:.xig  for  selectivity  bias,  we  will  assume  this 
model  accurately  captures  this  process. 

2.  Bstlmates  of  the  Pronotion  Model 

Table  VI  displays  the  estimated  logit  coefficients 
from  the  four  alternative  specifications  of  the  0-4  promotion 
model.  The  specifications  are  designed  to  illustrate  the 
marginal  effect  of  the  intact  of  FF6E  on  promotion  as  observed 
euxd  unobserved  factors  are  introduced  into  the  equation.  The 
first  model  specification  measures  the  total  effect  of  FFGE  on 
promotion  by  using  FFGE  as  the  only  e3q>leuiatory  varicQsle,  and 
the  second  measures  the  direct  effect  by  including  additional 
observed  factors  that  may  intact  promotion.  The  last  two 
model  specifications  are  de-'^sloped  frcrni  two  techniques  used  to 
determine  and  correct  for  the  presence  of  the  potential  bias 
associated  with  fully- funded  graduate  education  selection  by 
incorporating  into  the  model  unobserved  factors  cuid 
probabilities  for  FFGE  selection  for  each  observation  (the 
selection  approaches  are  discussed  fully  in  Chapter  II) . 
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TABLE  VZ.  LOOIT  BSTZMATBS  OF  TBK  PEGMOTZON 


VARIABLK 


FACTORS 


APFROACH 


BABHON 

APPROACH 


INTERCEPT 


EPCTREP 


LPCTREP 


1.29 

(18.30) 


HISLROTC 


HISELOCS 


LOSIAOTC 


LOSELOCS 


NESEP 


FEMALE 


MINORITY 


AGENOW 


MARONLY 


MARCHILD 


1.49 

1.45 

1.75 

(1.01) 

(.969) 

(1.17) 

1.02 

.991 

1.07 

(4.43)“ 

(3.72)“ 

(3.97)“ 

[.154] 

[.149] 

[.161] 

2.14 

2.14 

2.13 

(10.36)“ 

(10.37)“ 

(10.39)“ 

[.323] 

[.323] 

[.321] 

-.364 

(-1.18) 

[-.055] 


-.350 

(-.258) 

[-.053] 


3.01 

(3.17)** 

[.454] 


-.092 

(-2.04)* 

[-.014] 


.365 

(1.41) 

[.055] 


.607 

(2.58)“ 

[.092] 


-.356 

(-1.14) 

[-.054] 


.263 

(.781) 

[.040] 


-.331 

(-.244) 

[-.050] 


3.01 

(3.18)“ 

[.454] 


-.091 

(-2.02)* 

[-.014] 


.365 

(1.41) 

[.055] 


.606 

(2.58)“ 

[.091] 


.001 

(.002) 

[.000] 


-.349 

(-1.12) 

[-.053] 


-.415 

(-.306) 

[-.063] 


3.04 

(3.25)“ 

[.458] 


.130 

(.424) 

[.020] 


-.099 

(-2.19)* 

[-.015] 


.395 

(1.53) 

[.060] 


.622 

(2.66)“ 

[.094] 


DIVCHILD 


DIRECT  EFFECT 

1 

V3UUUSLK 

TOTAL 

OBSERVED 

HSCEMAN 

BARMOW 

EFFECT  * 

FACTORS  - 

APPROACH 

PHAT 

«  «  «■ 

«  A  « 

•  •  • 

— 

... 

— 

— 

— 

— 

CHI-SQUARED  LL 

53.18“ 

577.79" 

577.83" 

569.28“ 

PREDICTION  RATIO 

81.5  % 

89.2  % 

89.1  % 

88.6  % 

*  First  figxire  is  logit  coefficient  estimate,  the  t-statistic  is  in 
parentheses,  and  the  change  in  probability  obtained  by  multiplying 
the  coefficient  by  Px(l-P)  is  in  brackets,  idiere  P  is  percent  of 
saoqple  prosKtted  (.815).  [Ref.  19] 

*  Significant  at  the  .05  level. 

**  Significant  at  the  .01  level.  | 

a.  Total  Effect  of  FFGB 

The  first  coliunn  in  TcJole  VI  displays  the  results 
of  the  total  effect  of  FF6E  on  promotion.  As  can  be  seen, 
having  fully> funded  graduate  education  was  highly  significant 
in  this  model  specification.  If  one  were  to  consider  FFGB  as 
the  only  factor  explaining  promotion  to  0-4,  then  am  officer 
with  FFGB  would  be  25.2  percent  more  likely  to  promote, 
compared  to  am  officer  without  FFGB.  However,  as  discussed  in 
Chapter  III,  there  are  other  observed  or  measurable  factors 
that  contribute  to  promotion. 

b.  Effect  of  FPSE  with  Observed  Factors 

The  second  column  of  Table  VI  displays  the  results 
of  the  direct  effect  of  FFGB  on  promotion  to  0-4  after 
including  numerous  other  eiq}lanatory  variables  that  have  both 
a  direct  inpact  on  promotion  and  an  indirect  inpact  on 
selection  for  FFGB.  As  cam  be  seen,  although  still  highly 
significant,  the  magnitude  of  the  inpact  of  FFGB  on  promotion 
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has  decreased  dramatically  cooqpared  to  the  liqpact  In  the  total 
effect  specification.  Inclusion  of  the  observed  factors  in 
the  model  approximately  halved  the  probaUsility  of  promotion 
for  FFGE  officers,  or  by  11.6  percentage  points,  from  25.2 
percent  in  the  total  effect  specification  to  only  13.6  percent 
in  the  specification  with  observed  factors.  Cymrot's  study  on 
the  effects  of  graduate  education  on  promotion,  presented  in 
Chapter  II  [Ref.  2],  revealed  a  26  percent  increase  in  the 
probcLbility  of  promotion  to  0-4.  However,  his  model  suffered 
from  miaspecif ication  due  to  the  mixing  of  officers  from  all 
communities,  which  can  mask  isportcuit  community- specific 
factors,  euid  not  accounting  for  other  observed  factors 
significant  in  explaining  promotion,  such  as  fitness  reports 
and  Navy  experience.  He  included  only  personal  demographics, 
time  in  rank,  service  continuity,  emd  officer  community 
designator. 

Of  the  other  observed  factors  included  in  the 
specification  in  column  2  of  Tcd>le  VI,  13  had  statistically 
significeuit  impacts  on  promotion.  The  percent  of  LT  FITREPs 
recommended  for  early  promotion  (LPCTREP)  had  the  largest 
effect,  with  a  one  percent  increase  in  this  percentage 
increasing  the  probability  of  promotion  to  0-4  by  32.3 
percent,  while  a  one  percent  increase  in  the  percent  of 
"early"  FITREPs  RAP'd  was  associated  with  only  a  15.4  percent 
increase  in  promotion  probability.  Personal  demographic 
variables  revealed  significeuit  effects  on  promotion  for 
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females,  who  were  45.4  percent  more  likely  to  promote  tham 
males,  emd  those  married  with  children,  who  were  9.2  percent 
more  likely  to  promote  than  single  officers.  All  but  one  of 
the  Navy  e3q>erience  variaUales  (EARSWO)  had  significant  effects 
on  promotion.  Nuclear  officers  were  36.2  percent  more  likely 
to  promote  thcui  conventional  officers;  officers  not  serving  on 
a  CRUDES  ship  were  18.4  percent  less  likely  to  promote;  not 
attending  Department  Head  school  before  the  0-4  promotion 
board  decreased  the  probability  of  promotion  by  27.1  percent; 
euid  achieving  cm  EOOW  or  TAO  qualification  increased  one's 
promotion  probability  by  10  percent.  Finally,  there  were 
significeuit  positive  fiscal  year  effects  for  1985,  1986,  auid 
1987  (con^ared  to  1990}  .  Given  these  signlfiCcuit  variaUales, 
the  multivariate  results  seem  to  be  consistent  with  the 
bivariate  indications. 

c.  Heckman  i^jproacb 

The  third  column  of  Table  VI  displays  the  results 
of  the  Heclonan  approach,  the  first  of  two  techniques  used  to 
correct  for  potential  selection  bias.  Coefficient  estimates 
for  all  the  observed  factors,  including  signs  and  measure  of 
significance  are  nearly  identical  to  those  in  the  model 
specification  in  column  2  with  one  notable  exception,  the 
estimated  effect  of  FFGE.  The  introduction  of  unobserved 
factors  (contained  in  LAMBDA)  based  on  the  probability  of  FFGE 
selection  for  each  officer,  obtained  from  the  probit  selection 
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model,  resulted  In  FF6E  having  an  Inslgnlflcauat  In^ct  on 
promotion.  A  change  In  the  significance  of  the  treatment 
varleLble  (FF6E)  is  generally  an  indication  that  selection  bias 
was  present  in  the  model  euid  a  statistically  significant 
estimate  of  the  correction  factor  (LAMBDA)  would  provide 
confirmation.  However,  the  estimate  for  LAMBDA  was 
insignlflceuit  --  that  is,  no  selection  bias  was  detected. 

Due  to  the  insignificance  of  LAMBDA,  very  little 
can  be  said  concerning  the  inqplicatlons  of  the  chamge  in  the 
FFGE  estimate.  Although  the  results  of  the  Heckman  procedure 
isplies  that  FFGE  adds  no  value  to  promotion,  the  inedsllity  to 
Identify  (predict)  those  officers  with  FFGE  in  the  selection 
model  reduces  the  level  of  confidence  placed  on  the  results  of 
the  Heckmcui  procedure.  Since  detection  of  selection  bias  is 
highly  dependent  on  an  accurate  specification  of  the  selection 
probit,  one  Ccui  only  speculate  that  there  are  unidentified 
varled}les  omitted  from  the  problt  selection  model  that  would 
help  to  explain  FFGE  selection  more  accurately, 
d.  Bamotf  J^pproacb 

The  fourth  column  of  TeQ)le  VI  displays  the  results 
of  an  alternative  technique  to  correct  for  the  presence  of 
potential  selection  bias.  As  discussed  in  Chapter  III, 
instead  of  using  FFGE,  this  model  specification  utilizes  the 
calculated  probabilities  of  FFGE  selection  for  each  officer, 
obtained  from  the  selection  probit,  in  a  new  explanatory  term 
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called  PHAT.  This  purges  the  equation  of  emy  endogeneity 
between  promotion  emd  FF6E;  which  could  potentially  bias  the 
estimate  of  FFGE  on  promotion.  i 

As  was  the  case  in  the  Heckmeui  approach,  the 
coefficient  estimates,  signs,  euid  measure  of  signlficcuice  for 
all  the  observed  factors  are  nearly  identical  to  those 
obtained  in  column  2.  The  coefficient  of  PHAT  was  sdLmilar  to 
that  of  FFGE  in  the  Heckman  model,  positive  but  statistically 
insignificant.  Again,  given  the  poor  predictive  ability  of 
the  selection  problt,  the  relicUbility  of  this  model  is 
somewhat  questioned. 

3.  Bstlaatss  of  the  Percent  SAP  of  LT  FZTSSPs  Model 

Table  VII  displays  the  ordinary  least  squares  (OLS) 
model  results  for  each  of  the  four  specifications  of  the 
intact  of  FFGE  on  the  percent  of  LT  FITREPs  receiving  an  early 
promotion  recommendation.  Since  most  officers  attain  FFGE  at 
the  five  or  six- year  point,  this  measure  intends  to  evaluate 
post -FFGE  performcuice.  As  in  the  promotion  model,  the  four 
model  specifications  are  designed  to  illustrate  the  marginal 
effect  of  FFGE  on  LT  FITREP  performance  as  observed,  and  then 
unobserved,  factors  are  introduced  into  the  model. 
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TABLE  VZI. 

MfinT. 


OLS  BSTXMATBS  OF  TBB  PBBCBNT  OF  LT  FITSBFS  RAF 


TOTAL 

KFFICT  * 


FACTORS 


DIRICT  IFFICT 


APPROACH 


.004 

(.023) 


.133 

(1.66) 


-.050 

(-1.41) 


-.006 

(-1.21) 


.026 

(.911) 


.030 

(1.17) 


-.133 

(-1.93) 


.078 

(1.92) 


-  .097 
(-2.43)* 


-.139 

(-5.89)“ 


.113 

(5.52)“ 


-.002 

(-.013) 


.130 

(1.63) 


-.049 

(-1.40) 


-  .006 
(-1.30) 


.026 

(.921) 


.030 

(1.18) 


-.129 

(-1.89) 


.081 

(1.99) 


-  .097 
(-2.44)* 


-  .137 
(-5.81)“ 


.121 

(5.62)“ 


BARHOIf 

APPROACH 


.828 

(5.43) 

.848 

(5.56) 

.859 

(5.58) 

.126 

(6.19)“ 

.143 

(5.84)“ 

.141 

(5.67)“ 

-.007 

(-.240) 

-  .011 
(-.360) 

-.011 

(-.358) 

-.008 

(-.231) 

-  .020 
(-.575) 

-  .018 
(-.521) 

-.058 

(-1.79) 

-.062 

(-1.92) 

-  .062 
(-1.90) 

-.015 

(-.468) 

-.028 

(-.840) 

-  .026 
(-.772) 

-.003 

(-.015) 


.135 

(1.69) 


-.051 

(-1.42) 


-  007 
(-1.37) 


.027 

(.940) 


.031 

(1.20) 


-  .130 
(-1.89) 


-  .099 
(-2.47)' 


-  .139 
(-5.89)* 


.120 

(5.53)“ 


OIXBCT  EPraCT 

1 

VARZABLB 

OBSERVED 

BARMON 

FACTORS 

APPROACH 

APPROACH 

BOOWQCIAL 

^  m  m 

.089 

.092 

.091  1 

— 

(4.45)“ 

(4.60)“ 

(4.52)“ 

TAOQUAL 

... 

.061 

.061 

.061 

— 

(2.80)“ 

(2.82)“ 

(2.82)“ 

FFGE 

.113 

.022 

-  .113 

•  •  » 

(4.38)“ 

(.869) 

(-1.03) 

— 

LAMBDA 

m  m  m 

•  •  . 

.081 

-  •  • 

— 

— 

(1.26) 

— 

PHAT 

«  •  • 

... 

•  •  • 

-  .102 

— 

— 

— 

(-.875)  1 

ADJUSTED  R- SQUARED  ^ 

.012 

.156 

.157 

.156  1 

F- STATISTIC  * 

19.17" 

14.66“ 

14 . 04“ 

14.66“  1 

*  First  figure  is  OLS  coefficient  estimate  and  represents  the  I 

percent  change  of  LT  FITREPs  rapped  associated  with  a  one  unit  fl 

increase  in  the  variable,  the  t- statistic  is  in  peurentheses . 

^  Adjusted  R-Squared  and  F>Statistic  indicate  goodness-of -fit  for  a 
linear  model  estimated  by  OLS. 

Significant  at  the  .05  level. 

a.  Total  Effect  of  FFGB 

Colxunn  1  of  Table  VII  displays  the  results  of  the 
total  effect  of  FFGE  on  the  percent  of  LT  FITREPs  receiving  a 
RAP  (LPCTREP) .  As  Table  VII  shows,  FFGE  had  a  significant 
positive  intact  on  LPCTREP,  when  used  as  the  only  explanatory 
variable.  Officers  with  FFGE  received  11.3  percent  more  LT 
FITREPs  with  a  recommendation  for  early  promotion.  In  order 
to  obtain  a  more  accurate  estimate  of  the  effect  of  FFGE  on 
LPCTREP,  other  observed  factors  that  also  effect  LPCTREP  must 
be  incorporated  into  the  model. 
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b.  Effect  of  FPGB  with  Obaezved  Factors 

Coliunn  2  of  Table  VII  displays  the  results  of  the 
direct  effect  of  FFGE  on  the  percent  of  LT  PITREPs  receiving 
early  promotion  recommendations  after  Including  numerous  other 
e3lpl^matory  variables  that  have  both  a  direct  intact  on 
LPCTREP  cuid  an  indirect  intact  on  selection  for  FFGE.  The 
statistical  insigniflccuice  of  FFGE  in  column  2  iii^lies  that 
FFGE  plays  a  negligible  role  in  determining  LT  FITREP 
performcuice  when  other  observed  e3q>lanatory  factors  are 
included  in  the  model.  This  result  seems  to  conflict  with 
what  was  in^lied  in  the  bivariate  analysis,  where  officers 
with  FFGE  appeared  to  perform  significantly  better  on  LT 
FITREPs  in  all  the  varicQsles.  It  should  be  noted,  however, 
the  value  that  FFGE  adds  to  the  propensity  of  attaining  early 
promotion  recommendations  on  LT  FITREPs  Ccumot  be  discounted, 
due  to  the  fact  that  FFGE  became  insignificant  only  after 
accounting  for  Navy  e^erience  in  the  model. 

Of  the  other  observed  factors,  only  early  FITREP 
performance  and  Navy  experience  variables  had  statistically 
significant  in^acts  on  LPCTREP.  A  one  percent  increase  in  the 
percent  of  early  (ENS/LTJG)  FITREPs  recommended  for  early 
promotion  (EPCTREP)  was  associated  with  a  12.6  percent 
increase  in  LPCTREP.  The  significant  Navy  experience 
variables  revealed  that  not  serving  on  a  CRUDES  ship  and  not 
attending  Department  Head  school  decreased  LPCTREP  by  9.7  and 
13.9  percentage  points,  respectively;  achieving  an  early  SWO 
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qualification,  an  EOOW  qualification,  amd  a  TAO  qualification 
Increased  LPCTREP  by  11.3,  8.9,  euid  6.1  percentage  points, 
respectively.  Although  the  adjusted  R- squared  was  fairly  low, 
the  F- statistic  was  highly  significant  at  the  .01  level. 
Indicating  a  good  fit. 

c.  Heckman  Approach 

Coliunn  3  of  Tcible  VIZ  displays  the  results  obtained 
when  Incorporating  unobserved  factors  based  on  the 
probabilities  of  FF6E  selection  for  each  officer  Into  the 
model  to  correct  for  potential  selection  bias.  The  parameter 
estimates  and  statistical  signlflcamce  of  all  the  observed 
factors,  except  for  FF6E,  were  nearly  Identical  to  those 
obtained  In  column  2.  As  was  the  case  In  the  promotion  model, 
the  correction  factor  (LAMBDA)  cuad  FF6E  were  statistically 
insignificant  to  the  .05  level;  however,  the  change  In  sign 
(to  negative)  of  the  FFGE  variable  and  the  somewhat  high  t- 
scores  for  both  FFGE  and  LAMBDA  (>1.0),  suggests  that 
attainment  of  a  FFGE  degree  could  possibly  hurt  post -FFGE 
FITREP  performance  when  accounting  for  unobserved  factors  In 
the  model. 

d.  Baznaw  Approach 

Column  4  In  Table  VIZ  displays  the  results  of  the 
second  technique  used  to  correct  for  potential  selection  bias 
in  the  LPCTREP  model.  As  in  the  Heckman  estimates  in  column 
3,  the  parameter  estimates  and  statistical  significance  for 
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all  the  observed  factors,  except  FFGE,  were  vlrtxially 
identical  to  those  obtained  in  column  2,  As  was  the  case  in 
the  promotion  model,  the  is^ct  of  FF(SE,  represented  by  the 
probcQdility  of  attaining  FFGE  (PHAT) ,  was  statistically 
insignificant  after  correcting  for  the  endogeneity  of 
selection  for  FFGE.  Consistent  with  the  Heckman  approach,  the 
inpact  of  FFGE  became  negative,  although  statistically 
insignificant,  suggesting  that  FFGE  could  be  detrimental  to 
post -FFGE  FITREP  performance. 

4.  Estimates  of  the  Last  LT  FITREP  RAP  Model 

Tcdsle  VIII  displays  the  logit  model  results  for  each 
of  the  four  model  specifications  used  to  measure  the  marginal 
effect  of  FFGE  on  the  probability  of  receiving  an  early 
promotion  recommendation  on  the  last  LT  FITREP.  As  discussed 
in  Chapter  III,  this  single  FITREP  is  used  as  a  performance 
measure  because  it  evaluates  post -FFGE  performance  and 
conpletes  a  trend  of  either  declining,  improving,  or  sustained 
LT  FITREP  performance  crucial  in  determining  promotion  to  0-4. 


100 


TABLB  VZZZ.  LOGZT  BSTZMILTBS  OF  THB  LAST  LT  FZTBBP  SAP 


DZRXCT  BPnCT 


VARIABZiX 


A6EN0W 


MARONLY 


.723 

(4.17)** 

1.103] 


-.003 

(-.039) 

[-.000] 


-.089 

(-.388) 

[-.013] 


-  .344 
(-1.32) 
[-.049] 


-.253 

(-.992) 

[-.036] 


-.276 

(-1.09) 

[-.039] 


9.95 

(.063) 

[1.00] 


.220 

(.390) 

[.031] 


-  .497 
(-2.01)* 
[-.070] 


-.019 

(-.514) 

[-.003] 


.748 

(3.46)“ 

[.106] 


.581 

(3.14)“ 

[.082] 


-.220 

(-.444) 

[-.031] 


.717 

(3.49)“ 

[.102] 


-  .005 
(-.053) 
[-.001] 


-  .088 
(-.381) 
[-.012] 


-  .340 
(-1.26) 
[-.048] 


-.252 

(-.984) 

[-.036] 


-.271 

(-1.02) 

[-.038] 


9.96 

(.063) 

[1.00] 


-  .497 
(-2.01)* 
[-.070] 


-.019 
(- .510) 
[-.003] 


.748 

(3.46)“ 

[.106] 


.581 

(3.14)“ 

[.082] 


-  .211 
(-.446) 
[-.030] 


Buoxcm 

Am 


INTERCEPT 

1.52 

1.50 

1.49 

1.42 

(20.14) 

(1.31) 

(1.29) 

(1.23) 

-  -  - 

-  -  - 

... 

... 

.697 

(3.33)“ 

[.100] 


-.008 
(- .090) 
[-.001] 


-  .081 
(-.353) 
[-.Oil] 


-  .334 
(-1.23) 
[-.047] 


-.251 

(-.975) 

[-.036] 


-.261 

(-.981) 

[-.037] 


9.95 

(.063) 

[1.00] 


-  .490 
(-1.98)* 
[-.069] 


-  .017 
(- .461) 
[- .002] 


.743 

(3.44)“ 

[.105] 


.576 

(3.12)“ 

[.082] 


-  .207 
(-.438) 
[- .029] 
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DIRICT  IFnCT 


NODEPHD 


EARSNO 


EOOHQOAL 


TAOQOAL 


.343 

(1.80) 

t.049l 


-.160 

(-.615) 

[-.0231 


-.702 

(-4.28)“ 

[-.1001 


-  .056 
(-.363) 
[-.0081 


.707 

(4.26)“ 

[.1001 


.92< 

(4.4:^.' 

[.1311 


-.163 
(-.786) 
[- .0231 


CHI-SQUAREO  LL 


PREDICTION  RATIO 


82.9  % 


156.56 


83.5  % 


-.160 

(-.615) 

[-.0231 


-.703 

(-4.27)“ 

[-.1001 


-  .059 
(-.359) 
[-.0081 


.706 

(4.22)“ 

[.1001 


.926 

(4.49)“ 

[.1311 


-.114 
(-.120) 
[- .0161 


-.029 

(-.053) 

[-.0041 


156.56 


83.5  % 


BARiroir 


.162 

(.476) 

[.0231 


-.150 

(-.575) 

[-.0211 


-.690 

(-4.22)“ 

[-.0981 


-.067 

(-.399) 

[-.0101 


.704 

(4.20)“ 

[.1001 


.922 

(4.46)“ 

[.1311 


.064 

(.064) 

[-.0091 


155.96“ 


83.5  % 


*  First  figure  is  logit  coefficient  estimate,  the  t-statistic  is  in 
parentheses,  and  the  change  in  probability  obtained  by  multiplying 
the  coefficient  by  Px(l-P)  is  in  brackets,  idiere  P  is  the  percent  of 
the  sample  receiving  a  RAP  (.829). 

^  Significant  at  the  .05  level. 

“  Significeuit  at  the  .01  level. 


a.  Total  Effect  of  FFGE 


Column  1  of  Table  VIII  displays  the  logit  results 
when  PFGE  is  used  as  the  only  explanatory  variable  for  the 
probability  of  receiving  an  early  promotion  recommendation  on 
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the  last  LT  FITREP  (LASTLTRP) .  As  discussed  in  Oiapter  III, 
the  significance  of  FF6E  in  this  total  effect  specification 
merely  establishes  a  relationship  between  the  performance 
measure  euid  FF6E.  Although  FFGE  had  a  rather  high  t- score,  it 
was  statistically  insignificant  to  the  .05  level.  It  is 
likely  that  FFGE  will  have  no  effect  on  LASTLTRP  within  the 
three  remaining  model  specifications,  due  tc  3  poor 
representation  in  the  total  effect  specification.  Although 
the  predictive  ability  of  the  specification  was  good,  with  a 
correct  prediction  ratio  of  82.9  percent,  the  low  Chi-Square 
statistic  of  only  3.44  was  insignificamt,  indicating  a  poor 
fit. 

b.  Effect  of  FFGE  w±tb  Obaerved  Estctora 

Column  2  of  Table  VIII  displays  the  LASTLTRP  logit 
results  after  including  other  observed  factors  that  help  to 
explain  whether  or  not  a  SWO  receives  an  early  promotion 
recommendation  on  the  last  LT  FITREP.  As  expected,  FFGE  had 
a  statistically  insignificant  inpact,  which  seems  to  be 
consistent  with  the  bivariate  analysis,  where  the  mean 
LASTLTRP  performance  differences  between  those  with  and 
without  FFGE  were  not  that  great.  Of  the  statistically 
significant  varicQ^les,  achieving  a  TAO  qualification  before 
the  0-4  promotion  board  had  the  largest  inpact:  the 
probability  of  receiving  a  RAP  on  the  last  LT  FITREP  was  13 . 1 
percent  higher  for  those  with  a  TAO  qualification,  early 
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FITRBP  performance  (BPCTRBP)  had  a  highly  significant  positive 
effect  on  LASTLTRP,  with  a  one  percent  Increase  in  BPCTRBP 
Increasing  the  prt^aablllty  of  receiving  a  RAP  by  10.3 
percentage  points.  Other  slgnif learnt  varladsles  revealed  that 
minorities  were  7  percent  less  likely  to  receive  a  RAP  on  the 
last  LT  FITRBP,  married  with  or  without  children  Increased  the 
likelihood  of  receiving  a  RAP  by  8.2  auod  10.6  percent, 
respectively,  not  attending  Department  Head  School  decreased 
the  likelihood  by  10  percent,  and  attaining  an  BOOW 
qualification  increased  the  likelihood  by  10  percent.  The 
predictive  ability  of  the  model  In  column  2  was  good,  with  a 
correct  prediction  ratio  of  83.5  percent,  aucid  a  highly 
significant  Chi-Square  of  156.56  Indicated  a  good  fit. 
c.  Beckwan  Approach 

Column  3  of  Table  VIII  displays  the  logit  results 
after  introducing  the  selectivity  bias  correction  factor 
(LAMBDA) ,  which  accounts  for  unobserved  factors  taken  traca  the 
error  term  that  may  effect  both  the  likelihood  of  receiving  an 
early  promotion  recommendation  on  the  last  LT  FITRBP  and  the 
probcblllty  of  FF6E  selection  for  each  officer.  The 
coefficient  estimates  cmd  statistical  significance  for  all  the 
explcinatory  varlcibles  were  nearly  identical  to  those  obtained 
in  column  2.  As  was  the  case  in  the  first  two  performance 
measure  models  in  Tables  VI  and  VII,  both  LAMBDA  and  FF6B  were 
insignificant,  indicating  that  selection  bias  was  not  a 
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factor.  The  insignificance  of  the  correction  factor,  which 
again  may  be  attributable  to  the  poor  predictive  ability  of 
the  FF6E  selection  model,  essentially  renders  the 
Interpretation  of  the  treatment  variable  (FFGE)  meemlngless . 
d.  Barnour  J^jproacb 

Column  4  of  Table  VIII  displays  the  logit  results 
after  attempting  to  purge  the  model  of  endogeneity  that  may 
exist  between  FFGE  selection  and  receiving  an  early  promotion 
recommendation  on  the  last  LT  FITREP,  which  could  bias  the 
FFGE  estimate.  Instead  of  using  FFGE,  the  probcQslllty  of  FFGE 
selection  for  each  officer  (PHAT)  was  used  as  am  Instrumental 
variable  In  this  model  specification.  Statistically 
slgnlflcamt  varlaJales  were  the  same  as  those  obtained  In 
coliimn  2.  As  was  the  case  In  the  previous  two  perfozmamce 
models,  the  varlaQsle  used  to  measure  the  Impact  of  FFGE  on 
LASTLTRP  amd  to  correct  for  potential  selection  bias,  PHAT, 
was  Inslgnlflcamt.  This  Indicates  that  the  probaUQllltles  of 
FFGE  selection  had  a  negligible  Impact  on  receiving  a  RAP  on 
the  last  LT  FITREP. 
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V.  COHCXnSZONS  AMD 


This  chapter  stunmarlzes  the  conclusions  dravm  from  the 
enqplrical  analysis  of  this  thesis.  The  chapter  also  proposes 
recommendations  for  further  research  Into  the  effects  of 
graduate  education  on  officer  performance. 

A.  CQHCLXTSZOHS 

The  results  from  the  estimates  of  the  FF6E  problt 
selection  model  supported  the  CNO's  three  criteria  for 
selection  Into  the  fully- funded  graduate  education  program. 
The  statistical  significance  of  6PA,  math  skills,  and  number 
of  NPS  curricula  eligible  supported  the  undeirgraduate  academic 
performance  criteria;  the  statistical  slgnlflcemce  of  percent 
of  early  FITREPs  receiving  an  early  promotion  recommendation 
supported  the  greater  promotion  potential  criteria;  and  the 
statistical  slgnlflccmce  of  attaining  early  SWO,  BOOK,  or  TAO 
qualifications  supported  the  superior  professional  perf ormcuice 
criteria.  However,  the  ability  of  the  model  to  predict 
officers  with  FF6E  turned  out  to  be  very  poor,  most  likely  due 
to  the  Inadvertent  omission  of  inportant  unobservable  factors. 
Among  these  are:  c[uota  avallcdjlllty,  detaller  requirements, 
personal  preferences,  community  pressures,  and  motivation. 


The  results  of  this  thesis  provided  answers  to  some 
important  questions  concerning  the  effect  of  fully- fimded 
graduate  education  on  Surface  Warfare  Officer  performamce. 
First,  as  illustrated  in  Tcd>le  VI,  Chapter  IV,  fully- funded 
graduate  education  is  significantly  related  to  promotion  to  0- 
4.  Even  after  holding  constant  all  other  possible  observeible 
factors  that  would  have  an  ioqpact  on  promotion,  FF6B  remained 
a  highly  significant  euid  positive  determincuit  of  the 
probed>ility  of  promotion.  From  a  promotion  steuidpoint, 
leaving  the  warfare  environment  to  attain  FF6E  appears  to  be 
career- enhancing.  Although  FF6E  plays  a  significant  role  in 
promotion,  LT  FITREP  performance  euid  attending  Department  Head 
School  were  more  highly  slgnificemt  in  e3q>laining  promotion  to 
0-4.  It  is  also  interesting  to  note,  even  though  officers 
technically  have  no  control  over  it,  those  who  served  on 
CRUDES  ships  appear  to  have  eui  advantage  over  those  who  never 
served  on  a  CRUDES  ship.  This  could  add  some  "steam”  to 
claims  of  institutional  bias  within  the  Surface  Warfare 
community. 

Secondly,  as  illustrated  in  Tables  VII  and  VIII  in  Chapter 
IV,  fully- funded  graduate  education  has  a  statistically 
insignificant  impact  on  receiving  early  promotion 
recommendations  on  LT  FITREPs.  Although  the  distribution  of 
officers  with  and  without  FFGE  by  performance  measures, 
displayed  in  Figure  1  in  Chapter  I,  suggested  that  FFGE  causes 
better  performance  on  LT  FITREPs,  when  all  other  observed)le 
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factors  are  held  cozisteuit,  PFGB  because  Insignlflcauit  in  both 
the  percent  of  LT  FITREPs  RAP  model  and  the  last  LT  FITRBP  RAP 
model.  ^ 

It  should  be  noted,  however,  in  the  percent  of  LT  FITREPs 
RAP  model,  that  FFGB  became  inslgnlficamt  only  after  the  Navy 
esqperlence  variables  were  added  to  the  model.  This  inqplies 
that  both  FFGB  amd  Navy  escperlence  are,  in  fact,  correlated 
with  receiving  a  RAP  on  LT  FITREPs,  although  Navy  experience 
factors  carry  more  weight  in  determining  this  performaince 
measure.  Consistent  with  the  promotion  model,  the  two  FITREP 
performance  models  indicated  that  previous  (early)  FITREP 
performamce  amd  attending  Department  Head  School  were  also 
very  inqportamt  factors  in  explaining  early  promotion 
recommendations.  Additionally,  although  professional 
qualifications  (ECX)W,  TAO)  were  also  significant  in  the 
promotion  model,  they  seemed  to  have  a  greater  effect  on 
FITREP  performance,  conpared  to  prcmiotion.  From  a  FITREP 
performance  perspective,  in  light  of  the  insignlficcuit  effect 
of  FFGE  on  LT  FITREP  performcUice,  amd  considering  that  most  of 
the  "observed"  LT  FITREPs  are  evaluated  after  FFGE  attainment, 
it  cam  be  concluded  that  leaving  the  warfare  environment  to 
attain  a  fully- funded  graduate  degree  neither  contributes  nor 
detracts  from  Surface  Warfare  career- enhamcement,  as  measured 
by  fitness  reports. 

Finally,  as  discussed  in  Chapter  II,  the  military  measures 
productivity  through  ’  performance  within  rank  (FITREPs) , 
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prc»notion,  and  retention.  The  contention  of  the  theory  of 
human  capital  Investment  that  formal  education  Increases 
productivity  appears  to  be  supported;  the  FF6E  varleible  mras 
highly  significant  In  the  promotion  measure  of  performcuice. 
However,  the  question  of  whether  graduate  education  alone 
accounts  for  the  Increased  productivity  has  yet  to  be 
answered,  due  to  the  IneJalllty  to  completely  Isolate  FF6E  from 
unobserved  factors  suspected  of  potential  selection  bias. 
Thus,  the  pay-off  to  the  Navy  from  Its  Investment  In  fully- 
funded  graduate  education  remains  unclear,  due  to  the  fact 
that  those  officers  promoted  with  FF6E  are  already  considered 
more  promoted)le  and  may  have  been  promoted  even  If  they  had 
not  attained  FFGE  (l.e.,  selection  bias).  This  leads  us  to 
the  results  obtained  from  the  two  approaches  used  to  determine 
and  correct  for  potential  selection  bias  associated  with  FFGE 
selection. 

Given  the  statistical  significance  of  the  observed  factors 
Included  In  the  selection  model,  one  could  conclude  that 
selection  for  FFGE  Is  not  random  and  that  selection  bias  would 
be  lnevltcd)le,  causing  the  coefficient  of  the  FFGE  varlcQale  to 
be  overestimated  In  the  performance  models.  However,  both  of 
the  techniques  used  to  determine  and  correct  for  potential 
selection  bias  (the  Heckman  and  Barnow  approaches)  found 
little  evidence  that  selectivity  was  a  pro£>lem.  Although  the 
confidence  In  the  results  of  these  selection  bias  models  Is 
much  degraded,  due  to  the  poor  predictive  ability  of  the  FFGE 
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selection  probit,  the  selection  correction  factor  (LAMBDA), 
from  the  Hecksan  approach,  and  the  probability  of  selection 
for  FFGE  (PHAT) ,  from  the  Bamow  approach,  both  had 
statistically  insignificant  effects  in  the  three  performance 
models.  These  two  techniques  attempted  to  accoxint  for  the 
possibility  that  officers  chosen  for  FFGE  were  better 
performers,  more  highly  motivated,  with  a  higher  desire  for 
achievement  and,  thus,  more  promotcQsle.  These  techniques  were 
unable  to  capture  these  unobservables,  hence,  the 
insignificeint  effect  of  selection  bias. 

As  discussed  in  the  section  on  selectivity  bias  in  Chapter 
II,  the  ed)ility  to  detect  and  correct  for  selection  bias  is 
highly  dependent  on  an  accurate  specification  of  the  selection 
model.  It  is  reasoncdsle  to  conclude  that  the  FFGE  selection 
model  adequately  captured  the  important  observable 
(measurable)  factors  in  the  selection  process;  however,  the 
inedsility  to  account  for  unmeasureddle  factors  such  as  billet 
availability,  detailing  priorities,  personal  preferences,  and 
individual  career  intentions  may  have  seriously  downgraded  the 
accuracy  of  the  selection  model  to  fully  capture  the  Navy's 
actual  FFGE  selection  process.  Again,  the  selection  model  was 
only  able  to  predict  6.7  percent  of  those  actually  with  FFGE. 
In  light  of  this  fact,  one  should  not  impulsively  conclude 
from  this  thesis  that  FFGE  has  no  value  added  to  SWO 
performance.  Consequently,  the  issue  of  whether  the  increase 
in  productivity  is  attributable  to  fully- funded  graduate 
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education  alone,  observable  factors,  and/or  unobservable 
factors  requires  further  research. 

s 

B.  SECGMMBMDATZONS  FOR  FURTHJUt  RBSSARCH 

Until  this  thesis,  no  known  attextipt  has  been  made  to  model 
selection  for  fully- funded  graduate  education.  The  PFGE 
selection  model  in  this  thesis  sufficiently  captures  observed 
(measurable)  factors  that  significantly  inqpact  selection  for 
FFGE,  but  apparently  do  not  contribute  to  amy  bias  that  may  be 
associated  with  those  officers  selected  for  FFGE.  Further 
research  on  the  FFGE  selection  process  is  recommended,  for  it 
is  possible  that  selection  bias  may  lie  within  factors 
unavailcQsle  in  the  data  set  used  for  this  thesis.  The  data 
for  this  study  classified  selection  for  FFGE  only  if  the 
officer  had  attained  a  fully- funded  graduate  degree.  The 
population  was  all  Surface  Warfare  Officers  regardless  of 
whether  they  were  qualified  for  graduate  education,  or  were 
given  the  option  to  pursue  it.  Individual  preferences  is  an 
inportant  factor  in  FFGE  selection  and  may  be  captured  by 
obtaining  data  on  all  officers  who  qualify  for  FFGE  and  on 
those  who  are  offered  it.  Hiis  approach  would  involve 
analyzing  individual  decisions  to  accept  graduate  education 
among  the  population  of  those  qualified  who  were  offered  the 
option  to  attend  graduate  education.  Timing  of  one's  transfer 
may  also  be  significant  in  the  selection  process  --  FFGE  may 
not  be  available  or  offered  to  an  individual  who  is 


transferring  in  the  middle  or  right  after  the  beginning  of  an 
academic  quarter  or  semester.  Although  difficult,  accounting 
for  these  factors  In  the  selection  process,  which  cam  also  be 
applied  to  other  Navy  communities,  should  be  the  goal  of 
future  research. 

This  thesis  utilized  data  that  provioed  career  "snapshots" 
of  Indl/ldual  officers  at  the  0-3  amd  0-4  promotion  board 
points.  Retrospective  data  were  then  assembled  on  these 
officers.  A  longitudinal  amalysls  of  cohort  data  would  reveal 
a  great  deal  more  Information  on  performamce  of  Individual 
officers  by  enadallng  the  researcher  to  follow  them  through 
their  career. 

Subspecialty  codes  are  acquired  In  conjunction  with  the 
attainment  of  a  fully- funded  graduate  degree.  It  would  be 
fruitful  to  graduate  education  policy  makers  to  incorporate 
technical  and  nontechnical  subspecialty  degrees  In  the 
perfonrance  analysis  to  determine  if  there  are  differences 
across  subspecialty  types.  This  could  indicate  which 
subspecialties  are  more  cost  effective  to  the  Navy. 

The  bivariate  analysis  in  Table  IV  of  Chapter  IV  revealed 
that  minorities  with  FFGE  failed  to  promote  as  favorably  as 
whites  with  FFGE,  even  though  they  maintained  higher  LT  FITREP 
RAP  percentages.  Although  the  multivariate  analysis  found 
that  minorities  were  statistically  insignificant,  in  light  of 
the  current  enphasis  on  minority  issues  within  the  military. 
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it  is  recommended  that  minority  promotion  rates  be  explored 
further . 

Only  one  community  (Surface  Warfare)  was  chosen  for 
analysis  in  this  thesis.  Due  to  the  differences  in  how 
different  communities  evaluate  officers,  sharp  differences  in 
career  paths  between  communities,  emd  the  lack  of  con^arcUsle 
Navy  experience  factors,  it  is  recommended  that  future 
research  efforts  analyze  the  effect  of  fully- funded  graduate 
education  on  other  communities  (remaining  URL,  6URL,  RL,  and 
Staff  Corps)  utilizing  identical  performcuice  measures  and 
modeling  techniques  utilized  in  this  thesis. 
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APPSaDIX 


As  discussed  at  the  end  of  Chapter  III,  the  decision  to 
leave  the  service  at  the  couplet Ion  of  one's  initial  tour  of 
obligation  represents  an  additional  level  of  selection, 
preceding  FFGE  selection,  that  may  effect  the  outcome  of  the 
three  perfonticuice  models.  That  Is,  the  sem^le  of  officers 
considered  for  promotion  to  0-4  Is  truncated  since  they 
represent  only  those  officers  remaining  In  the  Navy  through 
the  0-4  promotion  point.  Hence,  assuming  that  both  levels  of 
selection  are  Independent  from  one  amother,  a  multiple 
selection  approach  using  correction  factors  for  both 
separation  and  fully- funded  graduate  education  Is  Illustrated 
below. 

Table  IX  displays  the  results  of  a  problt  model  used  to 
e:q>laln  separation  behavior,  where  SEP-1  if  the  officer  left 
the  Navy  voluntarily  before  the  0-4  board,  else  SEP-0.  The 
Interservlce  separation  code  (ISC)  was  used  to  Identify 
voluntary  leavers,  all  other  leavers  and  those  leaving  the  SWO 
community  but  remaining  In  the  Navy  were  omitted  from  the 


Greene's  econcsmetric  software,  LINDBP,  addresses  dual  selection 
with  the  specification  of  a  bivariate  probit  with  selection  model.  Fran 
this  procedure,  a  term  called  RHO  is  obtained  emd  its  statistical 
significeuice  indicates  whether  the  two  selection  processes  eure 
interdependent  (RHO  significant) ,  or  independent  (RHO  insignificant) . 
However,  due  to  the  nature  of  the  selection  process  in  this  study  (the 
Bample  Iseing  restricted  to  "stayers”  only) ,  the  two  levels  of  selection 
were  treated  as  independent.  [Ref.  15] 
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analysis  In  cm  effort  to  capture  true  separation  behavior. 
Table  X  displays  the  results  of  each  performatnce  measure  after 
applying  a  dual  selection  approach  using  the  Heckmam 
technique,  where  LAMBDAl  represents  the  selection  correction 
factor  obtained  from  the  separation  problt  euid  IiAMBDA2 
represents  the  selection  correction  factor  obtained  from  the 
FF6E  selection  problt  displayed  In  Table  V,  Chapter  IV. 

As  Tcdile  IX  shows,  the  attributes  significantly 
contributing  to  the  likelihood  of  separation  prior  to  the  0-4 
promotion  board  were:  higher  undergraduate  GPA's;  OCS 
commissioned  officers,  especially  those  attending  a  less 
conpetltive  college,  con^ared  to  USNA  graduates;  and  never 
having  served  on  a  CRUDES  ship. 

On  the  other  hand,  attributes  significantly  contributing 
to  the  likelihood  of  remaining  In  the  Navy  were:  receiving  an 
early  promotion  recommendation  on  early  FITREPs;  commissioned 
through  ROTC,  coiipared  to  USNA;  being  female;  age  (where  a  one 
year  Increase  represented  a  13  percent  decrease  In  the 
probability  of  separating) ;  married  with  or  without  children 
and  divorced  with  children  (con^jared  to  being  single)  ;  nuclear 
officers  were  10.6  percent  less  likely  to  separate;  and  those 
attaining  a  SWO  qualification  prior  to  promotion  to  0-3  were 
6.2  percent  less  likely  to  separate. 
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TABLE  IZ.  PROBZT  BSTHCATBS  OF  TBB  "SKPABATZON*  MODEL. 


V3dlIABUC 

■ESSSaH 

CBAMOB  nr 

PROBABILITT  * 

BPCTREP 

-.305  (-4.89)'“ 

-  .102 

6PA 

.090  (2.74)  “ 

.030 

HISLROTC 

-.215  (-2.53)  ” 

-  .072 

HISBLOCS 

.960  (10.24)  “ 

.322 

LOSLROTC 

-.191  (-1.89) 

-.064 

LOSBLOCS 

1.34  (14.30)  “ 

.448 

NBSBP 

-.557  (-.696) 

-  .187 

FBHALB 

-1.78  (-8.12)  “ 

-  .598 

MINORITY 

-.026  (-.239) 

-  .009 

AGBNOW 

-.387  (-27.99)  “ 

-  .130 

MARONLY 

-.306  (-4.50)  “ 

-.103 

MARCHILD 

-1.10  (-15.17)  “ 

-  .369 

DIVCHILD 

-.612  (-2.78)  " 

•  .205 

NDC 

-.315  (-2.79)  “ 

-.106 

NOCOMBAT 

1.14  (13.44)  " 

.383 

EARSWO 

-.185  (-3.05)  “ 

-.062 

BAREOOW 

-.089  (-.905) 

-.030 

BARTAO 

-.480  (-1.56) 

-  .161 

INTBRCBPT 

11.88  (27.85) 

-  -  -  - 

CHI-SQUARE  LOG  LIKELIHOOD 

2530.00“ 

PRBDICTION  RATIO  ^ 

87.2% 

'  Where  N«3,787  (1,477  stayed,  2,310  separated). 

^  t-statistic  in  parentheses  measures  significance  of  coefficient. 

^  Calculated  by  oiultiplying  the  estimated  coefficient  by  the 
density  of  the  standard  noxmal  distribution  function  corresponding  to 
the  particular  probability  level,  as  given  ^  the  cumulative  normal 
distribution  function  for  which  the  change  is  being  evaluated.  [Ref. 
19] 

*  Ratio  of  correct  predictions  over  total  ntonber  of  observations. 
Note:  82.1%  of  those  actually  staying  were  correctly  predicted,  90.4% 
of  those  actually  separating  were  predicted  correctly.  The  model 
also  predicted  that  62.2%  of  the  saaple  would  separate,  while  61% 
actually  did. 

Significant  at  the  .05  level. 


Significant  at  the  .01  level. 


In  terms  of  the  fit  of  the  model,  the  chi-square  log 
likelihood  statistic  was  highly  significant  and  the  model 
correctly  predicted  82 . 1  percent  of  those  actually  staying  amd 


90.4  percent  of  those  actually  separating  for  a  condained 
prediction  ratio  of  87.2  percent.  Combined  with  this 
extremely  high  prediction  ratio  for  those  separating  (relative 
to  the  6.7  percent  obtained  in  the  FFGE  selection  model),  auid 
the  fact  that  13  of  the  18  variables  used  to  esqplain 
separation  behavior  were  highly  signlficcuit  (at  least  to  the 
.01  level),  in^lies  that  the  specification  of  the  model  is 
accurate  in  capturing  separation  behavior  and  may  be  evaluated 
as  relioJsle. 


TABLE  Z.  BSTZMATBS  WITH  THE  DDAL- SELECTION  BECKMAN  TBCBNZQDB 
FOR  BACH  PERFORMANCE  MBASX7RB. 


BBOaOH  TBCBSIQDB  *  I 

vaaiABLis 

PROMOn 

LPCTRBP 

LASTLTSP 

INTERCBPT 

-1.34 

-  .056 

(-.450) 

Wai 

(-.022) 

EPCTRSP 

1.08 

.135 

.763 

(3.86)- 

(5.23)- 

(3.53)- 

[.104] 

.... 

[.106] 

LPCTREP 

2.15 

•  •  •  • 

•  -  •  - 

(10.39)- 

[.207] 

.... 

1 

fcPA 

.067 

.015 

-.016  U 

(.607) 

(1.26) 

(-.180) 

[.007] 

[-.002] 

HISLROTC 

.083 

-.017 

-  .056 

(.278) 

(-.558) 

(-.239) 

[.008] 

---- 

[-.008] 

HISELOCS 

.088 

.007 

-  .477 

(.217) 

(.154) 

(-1.42) 

[.009] 

-  -  -  - 

[- .066] 
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ZABLI8 


LOSLROTC 


LOSBLOCS 


MARONLY 


HARCHILD 


DIVCHILD 


NOCOMBAT 


NODEPHD 


EOOWQIIAL 


PROMOTB 


-.304 

(-.962) 

[-.029] 


-.071 

(-.155) 

[-.007] 


-.211 

(-.154) 

[-.020] 


-.017 

(-.204) 

[-.002] 


.482 

(1.72) 

[.046] 


.923 

(2.46)" 

[.089] 


2.48 

(4.17)“ 

[.239] 


-1.61 

(-3.41)- 

[-.155] 


-1.81 

(-9.37)- 

[-.174] 


-.106 

(-.496) 

[-.010] 


.642 

(3.21)“ 

[.062] 


UKnSBF 


-.066 

(-2.02)* 


-.017 

(-.095) 


-  .050 
(-1.41) 


-.004 

(-.096) 


-  .056 
(-1.01) 


-.135 

(-5.70)' 


.117 

(5.30)’ 


.092 

(4.58)’ 


LASTLIU 


-.227 

(-.879) 

[-.031] 


-  .461 
(-1.21) 
[-.064] 


10.03 

(.064) 

[1.00] 


-.493 

(-1.99)* 

[-.068] 


.809 

(3.46)“ 

[.112] 


.750 

(2.45)“ 

[.104] 


-.091 

(-.181) 

[-.013] 


-.362 

(-.929) 

[-.050] 


-.710 

(-4.30)“ 

[-.098] 


-  .032 
(- .185) 
[- .004] 


.703 

(4.20)“ 

[.097] 
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LAMBDAl 


LftMBPA2 


-SQOARSD  LL 


•.£15 

(-1.09) 

[-.OCO] 


-.142 

(-.185) 

(-.014) 


.068 

(1.04) 


-.324 

(-.694) 

t-.045] 


-.029 

(-.053) 

[-.004] 


PREDICTION  RATIO 


ADJUSTBO  R-S 


P- STATISTIC 


'  First  figure  is  coefficient  estimate,  the  t- statistic  is  in 
parentheses,  and  the  change  in  the  probability  associated  with  a  one 
unit  increase  in  the  e3q)lanatory  variable  obtained  by  multiplying  the 
coefficient  by  Px(l-P)  is  in  bracicets,  idiere  P  is  the  percent  of 
observaticms  predicted  correctly. 

^  IiAMBDAl  is  the  selection  bias  correction  factor  obtained  from 
the  separation  probit. 

^  LAMBDA2  is  the  selection  bias  correction  factor  obtained  from 
the  FFGE  selection  probit. 

Significant  at  the  .05  level. 

~  Significant  at  the  .01  level. 
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The  results  obtained  for  each  perfornumce  measure  through 
the  dual  selection  Heckman  approach,  displayed  in  Table  X, 
were  very  similar  to  those  obtained  using  the  single  selection 
Heckman  approach  (see  Tables  VI,  VII,  amd  VIII,  Chapter  IV)  . 
The  coefficients  for  FF6E  and  the  selection  correction  factor 
(LAMBDA  cuxd  IjAMBDA2)  ,  obtained  fron  the  FFGE  selection  probit, 
in  both  the  diial  and  single  selection  Heckman  approaches  for 
each  performaince  measure  were  virtually  identical  and 
inslgnificcuit .  Additionally,  Table  X  revealed  that  the 
selection  correction  factor  (LAMBDAl) ,  obtained  from  the 
separation  probit,  was  Inslgnificeuit  in  all  three  performance 
models.  The  fact  that  the  coefficient  for  FFGE  remained 
constant  emd  the  separation  selection  correction  factor  was 
insignificant  in^lies  that  accounting  for  the  additional  level 
of  selection  (separation) ,  has  no  effect  on  the  impact  of  FFGE 
on  performance.  As  discussed  earlier,  the  ability  to  detect 
and  correct  for  selection  bias  is  highly  dependent  on  the 
correct  specification  of  the  selection  probit.  Consequently, 
these  results  are  notable  due  to  the  relielbility  of  the 
separation  problt. 
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